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MAYDAYS  AND  MURPHIES; 

A  STUDY  OF  THE  EFFECT  OF  ORGANIZATIONAL  DESIGN, 
TASK,  AND  STRESS  ON  ORGANIZATIONAL 
PERFORMANCE 

ABSTRACT 

How  should  organizations  of  intelligent  agents  be  designed  so  that  they  exhibit  high 
performance  even  during  periods  of  stress?  We  present  a  formal  model  of  organizational 
performance  given  a  distributed  decision  making  environment  in  which  agents  encounter  a 
radar  detection  task.  Using  this  model,  we  examine  the  performance  of  organizations  with 
various  organizational  designs  and  task  characteristics  subject  to  various  stresses.  We 
distinguish  two  types  of  stress  —  external  stress  (such  as  hostile  events  that  we  call 
maydays)  and  internal  stress  (such  as  communication  channel  breakdown  that  we  call 
murphies).  This  formal  analysis  suggests  that;  (1)  regardless  of  stress,  performance  is 
enhanced  if  there  is  a  match  between  the  complexity  of  organizational  design  and  task;  (2) 
task  characteristics  and  maydays  (external  stress)  have  more  effect  on  performance  than 
murphies  (internal  stress)  and  organizational  design;  (3)  the  effects  of  murphies  (internal 
stress)  can  be  combated  by  training,  but  only  to  a  limited  extent;  (4)  technology  induced 
stress  typically  is  more  debilitating  than  personnel  induced  stress. 


INTRODUCTION 


It  was  July  3,  1988,  the  Persian  Gulf.  On  board  the  most  advanced  Aegis  warship, 
U.S.S.  Vincennes,  a  group  of  operators  was  working  intensively  in  front  of  the  radar 
defense  system.  Suddenly,  they  detected  a  signal  of  attack  by  an  "enemy  F-14  fighter". 
The  warning  signal  was  immediately  sent  to  Captain  Will  Rogers  III,  who  without 
hesitation,  gave  the  order  to  fire.  Several  minutes  later,  an  Iranian  civilian  aircraft  with 
nearly  300  passengers  was  shot  down,  no-one  survived  (Cooper,  1988)’. 

Investigations  following  the  incident  suggested  many  possible  causes  for  the  tragic 
mistake.  One  criticism  was  that  the  Navy  lacked  training  in  real  fighting,  but  had 
experience  only  with  computer  games  and  "canned  exercises".  Consequently,  some  crew 
members  were  unprepared  and  misinterpreted  the  data  from  the  radar  system  when  facing  a 
real  and  highly  stressful  situation  such  as  the  Persian  Gulf  (Cohen,  1988).  Another 
criticism  was  that  the  Navy  was  not  properly  trained  for  low  intensity  conflict,  but  only  for 
superpower  confrontation,  and  their  personnel  as  well  as  war  machines  were  not  suitable 
for  the  Persian  Gulf  situation  (Duffy  et  al.,  1988).  Others  forwarded  the  criticism  that  the 
Navy  used  biased  judgments  in  dealing  with  the  Gulf  situation  (Watson  et  al.,  1988). 
Adm.  William  J.  Crowe  Jr.,  then  Chairman  of  the  Joint  Chiefs  of  Staff,  commented:  ’The 
rules  of  engagement  are  not  neutral.  They’re  biased  in  favor  of  saving  American  lives”. 
Others  pointed  out  that  incorrect  information  received  by  the  radar  system  regarding 
whether  the  aircraft  was  civilian  or  military  caused  the  tragedy  (U.S.  Congress.  1988). 
Still  others  challenged  the  commanding  hierarchical  structure  of  the  Navy  warship  and 
argued  that  the  mistake  was  caused  because  the  error  was  passed  to  the  captain  without 
sufficient  cross-checking  (Watson  et  al.,  1988). 

The  above  incident  demonstrates  that  a  variety  of  factors  may  contribute  to 
organizational  performance.  These  factors  include  organizational  design,  task,  and  stress. 
Despite  the  often  tacit  acknowledgment  that  these  factors  are  intimately  related,  few  studies 
have  systematically  and  simultaneously  explored  the  impact  of  these  factors  on 
organizational  performance.  Such  a  study  should  provide  insight  into  interactions  between 
these  factors.  We  examine  the  decision  making  performance  of  organizations  with  different 
designs  and  tasks,  under  conditions  where  there  are  either  or  both  external  and  internal 
stress.  The  organizations  we  examine  are  engaged  in  a  radar  detection  task,  which  though 
stylized,  resembles  that  faced  by  the  Vincennes. 

The  model  used  in  this  paper  extends  the  work  by  Carley  (1990.1991a, 
1991b,1992)  on  organizational  design.  Carley  examined  organizational  performance  for 
organizations  of  intelligent  agents  with  different  organizational  designs  when  the 
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organization  was  faced  with  a  binary  choice  task.  Carley’s  agents  learn  from  experience 
and  make  decisions  on  the  basis  of  new  information  and  their  experience.  The  agent  model 
is  referred  to  as  ELM,  the  experiential  learning  model.  In  this  paper,  we  examine 
organizations  of  ELM  agents  faced  with  a  trinary  ciioice  task  (radar  detection).  This 
analysis  enables  us  to  determine  the  extent  to  which  earlier  results  were  a  product  of  the 
specific  task  characteristics.  In  addition,  using  this  framework  we  examine  organizational 
designs,  task  characteristics,  and  stresses  not  heretofore  considered.  In  doing  this  analysis 
we  have  found  it  necessary  to  generalize  the  nature  of  crisis  by  treating  it  as  two  types  of 
stress  (internal  or  murphies  and  external  or  maydays).  The  result  of  these  extensions  is  a 
more  comprehensive  study  of  design.  To  preview  our  conclusions,  we  find  that  many  of 
our  results  are  consistent  with  those  found  by  Carley.  The  consistency  of  results,  despite 
moving  from  a  binary  to  a  trinary  task,  suggests  that  the  results  are  a  function  of 
organizational  design  and  stress  rather  than  the  number  of  choices  available  to  the  decision 
makers.  The  greater  comprehensiveness  of  this  study  demonstrates  that  Carley's  results 
are  a  special  case  because  of  the  task  environment  examined,  not  because  of  the  number  of 
choices  available  to  the  agents.  We  demonstrate  that  the  relationship  between 
organizational  design,  task,  and  stress  may  be  so  strong  that  different  designs  are  most  cost 
effective  for  different  task-stress  combinations. 

BACKGROUND 


Stress 

Organizations  often  face  stress.  Such  stress  often  is  characterized  in  terms  of 
crises.  For  example,  Perrow  (1984)  sees  organizations  as  being  stressed  when  they  face  "a 
crisis "  —  a  critical,  novel  scenario  which  essentially  is  inevitable.  As  another  example, 
March  and  Simon  (1958)  see  organizations  as  being  routinely  stressed  as  they  face 
suboptimal  operating  conditions.  Other  stresses  discussed  include  turnover  (Tushman  et 
al.,  1989;  Carley.  1992),  communication  breakdown  (Carley.  1991a),  and  environmental 
disasters,  such  as  Bhopal  (Sh«  ivastava,  1987).  Clearly  a  variety  of  types  of  stress  or  crises 
exist.  They  can,  however,  be  characterized  as  to  whether  they  are  predominantly  external 
to  the  organization  or  internal.  We  refer  to  predominantly  external  stresses  or  crises  as 
mavdavs.  They  are  characterized  by  a  critical  untypical  event  external  to  the  organization 
that  may  have  severe  consequences  (such  as  threat  to  life  or  the  environment).  Maydays 
stress  the  organization  because  they  force  individuals  in  the  organization  to  face  a  situation 
for  which  they  may  not  have  been  trained  and  for  which  the  incorrect  decision  may  have 
tragic  consequences.  We  refer  to  predominantly  internal  stresses  or  crises  as  murphies. 
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They  are  characterized  by  the  somewhat  more  common  disruptions  to  the  ideal  decision 
making  environment,  such  as  missing  information,  incorrect  information,  communication 
breakdown,  agent  unavailability,  and  agent  turnover.  Murphies  stress  the  organization 
because  they  force  individuals  in  the  organization  to  make  decisions  under  suboptimal 
conditions. 

In  examining  organizational  performance  it  is  important  to  consider  both  sources  of 
stress.  Maydays  are  important  to  consider  because  they  may  be  inevitable  (Perrow,  1984) 
and  the  consequences  of  the  organization's  decision  so  universally  important.  Murphies 
are  important  to  consider  because  they  are  so  pervasive  (Cohen  and  Mach,  1974)  and  yet 
potentially  capable  of  being  reduced,  if  not  prevented.  The  question  remains,  how  can 
organizations  cope  with  stress.  Two  strategies  that  have  dominated  the  literature  are  "better 
technology"  and  "better  trained".  The  better  technology  strategy  (Neuhauser,  1971)  is  an 
engineering  approach,  and  centers  on  the  idea  if  we  can  just  design  the  procedure  (andlor 
the  associated  equipment)  right,  then  crises  can  be  avoided.  But  if  Perrow  (1984)  is  right, 
better  technology  may  reduce  stress  but  it  will  not  completely  eliminate  it.  The  better 
trained  strategy  (Dunbar  and  Stumpf,  1989;  Green.  1989)  is  a  personnel  approach  and 
centers  on  the  idea  if  we  can  just  train  people  then  they  will  respond  more  quickly  and 
accurately  during  crises  thus  minimizing  the  impact  of  crises.  But  the  value  of  training  is 
indeterminate  (Hammond.  1973;  Ganster  et  al.,  1991).  A  third  strategy,  which  has  received 
less  attention  is  "better  design".  The  better  design  approach  (Malone.  1978;  Bunon  and 
Obel,  1984;  Carley.  1990, 199 la.  199 lb,  1992)  is  a  structural  approach,  and  centers  on  the 
idea  if  we  can  just  design  the  organization  right,  the  impact  of  crises  can  be  mitigated. 
Contingency  theorists  have  suggested  that  the  right  design  is  highly  situationally  specific 
and  so  little  general  guidance  or  simple  theory  of  design  can  exist  (Lawrence  and  Lorsch. 
1967;  Galbraith,  1973,  1977).  Efforts  at  forging  contingency  theory  into  a  theory  of 
design  have  gone  the  route  of  creating  expert  systems  replying  on  highly  situation  specific 
knowledge  (Baligh  et  al.,  1990;  Baligh  et  al.,  1992).  However,  as  Scott  (1987)  points  out 
"such  a  quest  not  only  overlooks  the  vast  diversity  of  existing  organizational  forms,  but 
also  fails  to  recognize  the  great  variety  of  tasks  undertaken  by  organizations"  and  also  "fails 
to  search  for  any  underlying  principles  to  guide  their  designs". 

We  suggest  that  there  is  a  systematicity  to  when  what  design  is  most  effective,  that 
there  are  underlying  principles  that  guide  design.  By  broadening  the  concept  of 
organizational  design  to  include  aspects  of  task,  and  training,  in  addition  to  structure,  and 
by  examining  performance  from  a  combined  design,  task,  and  stress  perspective,  it  is 
possible  to  develop  a  theory  of  design  that  suggests  strategies  for  mitigating  stress 
consistent  with  the  organizational  goals.  Or  as  Carley  (1990)  suggests  although  the  right 
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design  may  be  to  an  extent  situationally  specific,  there  is  an  underlying  systematicity  to 
what  works  when.  Thus,  although  organizations  with  different  designs  perform  differently 
given  different  tasks  and  subject  to  different  stresses,  there  are  systematic  shifts  in 
performance  as  these  factors  change.  Consequently,  organizations  can  choose  that  design 
which  admits  the  highest  performance  given  the  type  of  stress  and  task  they  expect  to 
encounter  most  frequently  or  for  which,  when  encountered,  has  the  most  costly 
consequences. 

Organizational  Design 

Organizational  design  has  been  viewed  from  a  variety  of  perspectives.  To  some, 
organizational  design  is  defined  by  the  formal  structure  and  the  task  decomposition 
structure  (Mintzburgh.  1983;  Bunon  and  Obel,  1984).  To  others,  factors  such  as  the 
degree  of  hierarchy  (Mackenzie.  1978).  or  the  structure  of  the  informal  network 
(Krackhardt,  1989)  characterize  the  organization's  design.  Others  focus  on  procedures  for 
combining  information  or  making  decisions  (Panning.  1986;  Radner.  1987).  Still  others 
focus  on  the  information  processing  characteristics  or  cost  of  the  organization  (March  and 
Simon.  1958;  Galbraith,  1973,  1977;  Malone,  1986;  Carley,  1990,  1991b).  Despite  the 
numerous  approaches  there  are  still  aspects  of  design  that  are  neglected.  An  often  neglected 
aspect  of  organizational  design  is  the  skill  level  of  the  employees,  i.e.,  do  you  hire  trained 
or  untrained  personnel. 

The  interest  in  design  largely  is  due  to  the  fact  that  organizations  can  alter  their 
design.  Hence,  to  the  extent  to  which  performance  is  related  to  design  organizations  can 
improve  their  performance  by  altering  their  design.  In  general  there  is  the  assumption, 
albeit  often  implicit,  that  organizational  performance,  or  at  least  the  organization's 
efficiency,  is  tied  intimately  to  the  organizational  design.  For  example.  Mackenzie  (1978) 
argues  that  the  degree  of  hierarchy  is  linked  directly  to  the  organization's  efficiency. 
Alternatively,  Malone  (1986)  and  Carley  (1990.  1991b)  have  suggested  that  the 
organizational  design  is  related  to  its  cost  and  consequent  performance-.  In  large  pan.  the 
relation  between  organizational  design  and  performance  is  expected  to  hold  because 
organizations  are  composed  of  intelligent  agents  who  can,  and  do,  learn  from  experience 
(March  and  Simon,  1958;  Carley,  1991,1992;  Carley  et  al,  forthcoming).  Thus  the 
organization's  performance  depends  on  the  performance  of  its  members  (Hastie,  1986). 
However,  the  agents'  performance  is  affected  by  the  organization’s  design  which  places 
constraints  on  the  agents. 

In  this  paper,  organizational  design  is  viewed  as  a  combination  of  organizational 
structure,  task  decomposition  scheme,  and  procedures.  Through  an  examination  of 
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multiple  designs,  the  expected  relations  between  design  and  jjerformance  will  be  deduced. 
Thus,  the  focus  of  our  analysis  is  on  the  relative  performance  of  various  designs.  This  is 
in  contrast  to  that  work  on  organizational  design  that  given  a  set  of  constraints  tries  to  locate 
the  optimal  design. 

Organizational  Task 

The  argument  can  be  made  that  organizational  theory  began  with  the  systematic 
study  of  tasks  (Taylor.1916;  Fayol,  1949).  This  tradition  is  followed  today  in  the  areas  of 
job  design  and  scheduling.  Nevertheless,  in  much  of  current  organizational  theory,  task  is 
overlooked  or  treated  exogenously  as  the  problem  to  be  solved  (Perrow,  1967;  Mackenzie, 
1978).  In  part,  task  is  overlooked  as  it  viewed,  as  it  is  in  this  paper,  as  a  feature  or  the 
environment.  The  task  can  be  thought  of  as  a  set  of  problems  external  to  the  organization. 
And  in  some  cases,  the  task  is  defined  by  the  given  technology  (Scott,  1987).  Within 
organization  theory  open  system  theory  (Scon,  1987)  and  population  ecology  (Hannan  and 
Freeman.  1977)  have  refocused  attention  on  the  environment,  though  not  directly  on  the 
features  of  the  task.  Research  in  artificial  intelligence,  and  of  particular  interest  to 
organizational  theorists,  research  in  distributed  anificial  intelligence  (Dreznick,  1986;  Bond 
and  Gasser.  1988;  Carley  et  al..  forthcoming),  have  clearly  demonstrated  the  importance 
of  the  task.  Such  research  demonstrates  that  features  of  the  task  serve  as  constraints  on 
what  organizations  are  most  effective,  and  even  possible  (Levis,  1988;  Demael  and  Levis. 
1991).  Despite  the  agreement  that  task  constrains  organizational  action  there  is  little 
agreement  as  to  what  are  the  salient  features  or  dimensions  of  tasks. 

Tasks  vary  on  a  large  number  of  dimensions,  not  the  least  of  which  is  complexity. 
There  have  been  numerous  studies  of  the  effect  of  task  complexity  on  organizational 
performance  (Wood  et  al..  1990).  These  studies  demonstrate  that  increases  in  task 
complexity  correspond  to  decreases  in  performance.  In  addition,  using  a  model  similar  to 
that  used  in  this  paper,  Carley  (1990)  found  that  organizational  performance  tended  to 
degrade  with  task  complexity.  One  aspect  of  task  that  has  received  some  attention  is  its 
decomposability.  The  common  wisdom  is  "divide  and  conquer"  (Babbage,  1832;  Massie. 
1965;  Tausky,  1970).  Decomposability  is  related  highly  to  interdependence  of  task 
components  (Roberts,  1989,  1990).  Problems  of  coordination  can  occur  if  organizational 
design  does  not  take  the  task  decomposability  into  consideration.  Another  aspect  of  task  is 
bias.  Or  to  describe  this  another  way,  organizations  can  operate  within  niches.  The  niche 
defines  what  types  of  problems  the  organization  sees.  Some  organizations  operate  within  a 
highly  sp)ecialized  niche  (Hannan  and  Freeman,  1977)  and  are  therefore  expected  to 
perform  well  in  a  specialized  environment.  Other  organizations  operate  within  a  more 
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generalized  niche  and  are  therefore  expected  to  perform  well  in  a  coarse-grained 
environment.  From  the  perspective  taken  in  this  paper,  organizations  within  a  specialized 
niche  are  coping  with  a  biased  task,  i.e.,  they  have  a  tendency  to  see  only  one  aspect  of  a 
more  general  problem.  Organizations  facing  unbiased  tasks  see  all  aspects  of  the  general 
problem  and  therefore  are  in  a  more  generalized  niche. 

MODEL 


Stylized  Radar  Task 

The  task  is  a  stylized  radar  detection  task.  There  is  a  physical  air  space  that  is  being 
scanned  by  the  agents.  Within  this  airspace,  during  any  specific  time  period,  there  is  a 
single  aircraft.  This  aircraft  may  be  friendly  (1),  neutral  (2).  or  hostile  (3).  Each  aircraft 
has  nine  characteristics  such  as  speed  and  direction  (see  Figure  1).  For  an  aircraft  each 
characteristic  takes  on  one  of  three  values,  e.g.,  the  speed  may  be  low.  medium,  or  high. 
The  indication  of  a  specific  characteristic  may  not  reflect  the  true  state  of  the  whole  aircraft. 
For  example,  while  the  aircraft  may  have  weapons,  and  so  on  the  characteristic  Radar 
Emission  Type  may  appear  hostile,  the  aircraft  when  all  characteristics  are  considered  may 
actually  be  fnendly.  The  number  of  possible  unique  aircraft  or  problems  is  19683  (3^). 

★★★Place  Figure  1  about  here*** 

We  choose  this  stylized  task  for  the  following  reasons:  First,  it  is  a  real  world 
problem.  The  task  has  been  widely  examined  in  military  and  civilian  (e.g.,  air-traffic 
control)  contexts.  Second,  it  is  a  very  general  task,  not  a  specific  or  narrowly  defined  task. 
Although  we  think  of  this  task  as  radar  control,  in  reality  it  is  a  trinary  choice  task,  and  any 
task  where  the  agents  can  choose  between  three  options  has  features  in  common  with  this 
task.  Third,  because  the  true  decision  can  be  known,  feedback  can  be  provided  and  so 
issues  of  training  can  be  addressed.  Fourth,  it  is  ideal  for  a  distributed  environment  as  the 
task  is  sufficiently  complex  that  multiple  agents  can  be  used  to  work  on  different  aspects  of 
the  task.  Fifth,  the  task  itself  has  a  limited  number  of  cases  (19683=3^)  and  so  numerical 
enumeration  techniques  can  be  used  to  evaluate  performance.  Sixth,  this  task  can  also  be 
thought  as  a  trinary  version  of  the  binary  choice  task  used  by  Carley 
(1990,1991a,1991b,1992),  so  admits  replication  and  extension  of  this  earlier  work.  And 
finally,  this  task  is  sufficiently  interesting  that  it  can  be  expanded  later  with  relative  ease  to 
include  many  other  factors,  such  as  communication  of  different  types  of  information  or 
different  process  rules  or  learning  rules  or  training  orientations.  This  makes  possible  a 
wide  variety  of  studies  using  the  same  task  and  so  enhances  the  prospect  of  cumulative 
research  in  this  area. 
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Task  Characteristics 

The  true  state  of  the  world  is  a  feature  of  the  task  that  is  external  to  the  organization, 
and  that  is  not  manipulatable  by  the  organization,  at  least  in  the  shon  run.  Such  true  states 
are  often  a  product  of  the  technology.  For  example,  within  the  radar  environment  aircraft 
that  are  moving  very  fast,  are  within  the  corridor,  are  carrying  weapons,  and  have  an 
unknown  identification  typically  are  hostile.  We  can  manipulate  the  "true  state  of  the 
world"  in  order  to  examine  different  types  of  tasks,  all  within  the  radar  scenario.  By 
altering  the  "reality"  faced  by  our  organizations  we  are  altering  the  definition  of  what 
constitutes  a  truly  friendly,  neutral,  or  hostile  aircraft.  Two  such  manipulations  are 
particularly  interesting,  given  the  previous  review  of  the  literature,  decomposability  and 
bias. 

A  task  environment  is  decomposable  if  there  are  no  complex  interactions  among 
components  that  need  to  be  understood  in  order  to  solve  a  problem.  In  a  decomposable  task 
each  component  has  a  separable,  identifiable  and  additive  effect  in  determining  the  problem 
solution.  Each  piece  of  information  contributes  equally  to  the  final  decision.  No  agent  has 
greater  "power"  simply  by  virtue  of  having  access  to  a  more  powerful  or  more  important 
piece  of  information.  In  contrast,  when  the  task  is  non-decomposable  then  the  pieces  of 
information  do  not  contribute  equally  to  the  final  decision,  and  portions  of  the  information 
interact  to  determine  the  true  nature  of  the  aircraft.  In  this  case,  some  agents  may  have 
greater  "power"  simply  by  virtue  of  having  access  to  more  powerful  or  more  important 
information.  Decomposable  tasks  are  less  complex  than  non-decomposable  tasks  due  to 
the  absence  of  complex  interactions. 

A  task  environment  is  biased  if  the  possible  outcomes  are  not  equally  likely. 
Biased  environments  are  quite  common.  For  example,  during  war  time  one  might  see 
many  more  hostile  than  friendly  aircraft.  In  an  unbiased  environment  approximately  one 
third  of  the  19683  aircraft  (6568)  are  hostile  and  one  third  of  the  aircraft  are  friendly.  This 
environment  can  be  thought  of  as  an  uncertain  environment  because  the  chance  of  all  three 
outcomes  are  almost  identical.  In  contrast,  biased  environments  are  more  certain  simply 
because  the  most  common  aircraft  is  hostile.  Biased  tasks  thus  are  less  complex  than 
unbiased  tasks  due  to  the  preponderance  of  a  particular  solution. 

Based  on  these  two  manipulations,  we  examine  four  different  "realities"  or 
environmental  situations. ^  These  four  environments  are  described  in  Figure  2.  Given  a 
particular  reality,  the  19683  problems  can  be  classified  as  being  "truly"  friendly,  neutral,  or 
hostile.  This  classification  involves  first  calculating  a  sum  of  the  values  of  all  nine 
characteristics  and  then  categorizing  the  aircraft  as  either  friendly,  neutral,  or  hostile 
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depending  on  the  value  of  the  sum.  As  can  be  seen  in  Figure  2  when  the  task  is 
decomposable  the  sum  is  based  on  an  unweighted  linear  combination  of  the  characteristics; 
whereas,  the  non-decomposable  task  uses  a  weighted  sum.  Further,  when  the  task  is 
unbiased  the  three  possible  outcomes  are  equally  likely;  whereas,  when  the  task  is  biased 
one  outcome  (hostility)  is  more  likely.  Thus,  as  shown  in  Figure  2.  the  number  of  aircraft 
that  are  "truly"  friendly,  neutral,  or  hostile  depends  on  the  environmental  situation. 

***Place  Figure  2^  about  here*** 

Organization  and  Task 

Each  time  period,  the  organization  must  scan  the  air  space  and  make  a  decision  as  to 
the  nature  of  the  aircraft  in  that  airspace.  The  organization  goes  through  this  process  19683 
times,  once  for  each  unique  aircraft.-'’ 

Each  time  period,  some  of  the  organizational  agents  (the  analysts)  access 
information  on  the  aircraft,  develop  a  recommendation  (their  opinion  as  to  whether  they 
think  the  aircraft  is  friendly  (=1),  neutral  (=2).  or  hostile  (=3)),  and  communicate  this 
recommendation.  How  these  recommendations  are  processed  or  combined  by  the 
organization  depends  on  the  organizational  structure.  This  will  be  discussed  in  the  next 
section.  Regardless  of  the  organizational  structure,  the  processed  (or  combined) 
recommendations  form  the  organization's  final  decision  on  that  aircraft  (the  organization's 
decision  that  the  aircraft  is  friendly  (=1),  neutral  (=2),  or  hostile  (=3). 

The  aircraft  really  exists,  and  is  therefore  "truly"  friendly  (=1),  neutral  (=2),  or 
hostile  (=3).  The  organization  is  not  omniscient  and  the  true  state  of  the  world  is  not 
known  apriori.  Rather,  it  must  be  determined  by  the  organization  by  examining  the  radar 
characteristics  of  the  aircraft.  Given  that  organizations  have  only  history  and  their 
understanding  of  their  current  technology  to  guide  them  the  organization  as  a  whole  has 
only  a  vague  understanding  of  the  true  state  of  the  world.  The  organization's 
understanding  resides  both  in  the  agents  and  in  the  pattern  of  relationships  among  the 
agents  (Carley,  1992).  The  agents'  understanding  of  the  true  state  of  the  world  depends  on 
how  they  were  trained.  Each  agent  is  assumed  to  be  intelligent;  i.e.,  each  agent  makes  a 
recommendation  or  decision  on  the  basis  of  all  the  task-based  information  available  to  the 
agent.  What  information  is  available  to  the  agent  depends  both  on  what  the  current  problem 
is  and  on  how  the  agent  was  trained. 

Organizational  Design 

In  this  paper,  organizational  design  is  characterized  by  three  factors  —  the 
organizational  structure,  the  task  decomposition  scheme,  and  the  organizational  procedures 
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(herein  limited  to  procedures  for  providing  training,  feedback,  communicating 
recommendations,  and  combining  these  to  create  an  organizational  decision).  By 
considering  all  three  factors,  design  elements  of  structural  theory,  resource  dependency 
theory,  and  institutional  theory  are  combined  in  a  single  formal  framework. 
Organizational  Structure 

We  examine  four  structures:  team  with  a  manager,  team  with  voting,  hierarchy,  and 
matrix^  (see  Figure  3).  Each  structure  consists  of  nine  baseline  analysts.  In  addition, 
some  structures  also  employ  middle  and/or  top-level  managers. 

♦★★Place  Figure  3  about  here*** 

These  structures  are  examined  because  they  represent  stylized  version  of  real 
organizations.  Each  type  of  structure  has  been  analyzed  by  various  research  traditions,  but 
rarely  has  their  performance  been  contrasted^.  Each  structure  has  features  which  have  been 
touted  as  enabling  it  to  perform  well  under  some  circumstance.  The  team  with  a  manager, 
for  example,  is  vinually  a  flat  hierarchy  such  that  while  each  analyst  examines  information 
and  makes  a  recommendation,  the  ultimate  organizational  decision  is  made  by  the  manager 
(or  team  leader).  Such  teams  are  common  in  settings  such  as  software  design  projects. 
They  are  the  simplest  of  centralized  structures  and  arguably  are  good  at  simpler  tasks.  The 
team  with  voting  is  a  collection  of  equals,  not  subject  to  any  supervisor,  who  together  make 
the  final  organizational  decision  by  majority  vote**.  Such  teams  are  common  in  settings 
such  as  congress  and  judiciary  systems.  They  are  the  simplest  of  the  decentralized 
structures,  and  arguably  are  quick  to  learn  new  information  but  are  rarely  resilient  in  the 
face  of  various  forms  of  stress  such  as  turnover  (Carley,  1991a,  1992).  The  hierarchy  is 
multi-leveled  and  designed  such  that  each  analyst  examines  information  and  makes  a 
recommendation  to  his  or  her  immediate  supervisor  who  in  turn  makes  a  recommendation 
to  the  top-level  manager  who  makes  the  ultimate  organizational  decision.  Hierarchies  have 
been  extensively  studied  (Simon,  1973;  Malone,  1987),  and  are  expected  to  absorb 
uncertainty  (Simon.  1973).  The  matrix,  like  the  hierarchy,  is  multi-leveled,  but  unlike  the 
hierarchy  has  cross-links  between  the  divisions  in  the  organization.  Thus  the  matrix  has 
"redundant"  communication  links  such  that  analysts  report  to  multiple  managers.  Matrix 
organizations  are  supposed  to  be  good  at  complex  tasks  and  to  sustain  more  uncertainty. 

In  the  foregoing  discussion,  we  tried  to  illustrate  that  these  are  unique 
organizational  structures  with  different  properties.  Moreover,  even  the  most  cursory 
examination  of  the  literature  demonstrates  that  each  of  these  structures  is  expected  to  have 
very  different  performance  profiles.  By  examining  these  typical,  albeit  stylized, 
organizational  structures  we  will  gain  insight  into  the  impact  of  organizational  structures  on 
organizational  performance. 
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Task  Decomposition  Scheme( Access') 

The  task  decomposition  scheme^  determines  the  distribution  of  raw  (unfiltered) 
information  to  members  of  the  organization.  In  our  model,  what  this  means  is  that  the  task 
decomposition  scheme  determines  which  analyst  has  access  to  which  type  of  radar  or 
surveillance  equipment.  Each  type  of  equipment  allows  that  analyst  to  gamer  information 
on  a  panicular  (or  a  particular  set  oO  characteristics.  We  examine  four  task  decomposition 
schemes  (see  Figure  4).  They  are:  segregated,  overlapped,  blocked,  and  distributed'®. 

***Place  Figure  4  about  here*** 

As  with  the  organizational  structures,  these  schemes  were  chosen  as  they  represent 
unique,  albeit  stylized,  patterns  of  distributing  the  task  information  across  analysts.  These 
schemes  represent  a  range  of  ways  in  which  task  based  information  can  be  differently 
accessed  by  members  of  the  organizational  structures.  In  choosing  these  schemes  we 
varied  two  features  —  how  much  information  overlap  exists  and  where  the  overlap  occurs. 
TTie  segregated  scheme  essentially  is  employing  the  divide  and  conquer  scheme.  It  has  been 
studied  by  Cohen  et  al.  (1972)  who  found  that  the  segregated  scheme  is  fragile  under 
stress.  Cohen  et  al.  (1972)  suggested  that  information  overlap  makes  the  organization  less 
reliant  on  the  whims  of  a  particular  employee  and  enables  the  organization  to  better  deal 
with  stresses  such  as  communication  breakdowns.  While  the  overlapped,  blocked,  and 
distributed  all  have  information  overlap  they  differ  in  how  that  overlap  affects  the  overall 
distribution  of  information  across  the  organization.  The  blocked  scheme  provides  complete 
redundancy  within  a  division  and  none  across  divisions.  Whereas,  the  overlapped  scheme 
provides  for  some  information  being  shared  between  divisions,  and  the  distributed  scheme 
guarantees  that  all  information  is  available  to  all  divisions.  The  teams  of  course,  do  not 
have  divisions,  so  the  impact  of  these  different  schemes  may  be  less.  By  considering  these 
variations  we  are  able  to  see  how  different  task  decomposition  schemes  impact 
organizational  performance. 

Organizational  Procedures 

The  artificial  organizations  we  examine  have  procedures  for  feedback, 
communicating  recommendations,  combining  recommendations  to  create  an  organizational 
decision,  and  training.  In  all  organizations  agents  during  their  training  phase  received 
accurate  and  immediate  feedback  as  to  what  was  the  correct  organizational  decision.  In  all 
organizations  agents  could  communicate  their  decision  only  to  their  immediate 
supervisor! s).  In  the  team  with  voting,  a  majority  rule  combination  procedures  was  used. 
In  all  other  organizational  structures  the  procedure  for  combining  subordinates’ 
recommendations  was  determined  by  the  supervisor.  Training  procedures  were 
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systematically  varied  across  all  organizations.  We  consider  the  effect  of  3  training 
procedures  —  no  training,  experiential  training,  and  training  in  standard  operating 
procedures  (SOPs).  As  with  the  organizational  structures  and  the  task  decomposition 
schemes  these  training  scenarios  are  stylized  but  they  do  reflect  types  of  training  prevalent 
in  real  organizations.  These  training  conditions  help  us  illuminate  the  effect  of  training  on 
organizational  performance. 

At  this  point  it  is  important  to  re-iterate  that  when  we  measure  organizational 
performance  we  are  dealing  with  organizations  composed  of  fully-trained  agents  (other  than 
under  certain  types  of  stressed  conditions).  In  all  cases  we  will  be  examining  the 
performance  of  organizations  after  the  training  process  has  been  completed.  The  agents  are 
not  going  through  a  training  process.  Rather,  the  agents,  already  have  as  much  training  as 
they  are  going  to  get.  Nevertheless,  in  order  to  fully  appreciate  why  the  organizations 
behave  as  they  do  it  is  necessary  to  understand  the  type  of  training  the  agents  received,  as 
well  as  the  exact  decision  procedure  followed  by  the  agents.  It  is  also  important  to  point 
out  that  within  an  organization  all  agents  are  either  untrained,  experientially-trained,  or 
operationally-trained  (other  than  under  cenain  types  of  stressed  conditions  where  untrained 
agents  become  mixed  with  either  experiential  training  or  operational  training). 

No  Training  Procedure 

In  the  untrained  condition,  the  agents  have  no  historical  information  or  standard 
operating  procedure  on  which  to  base  their  recommendation  so  they  simply  guess.  This 
condition  is  interesting  as  it  represents  a  baseline  against  which  to  compare  all  other 
organizational  behavior.  That  is,  given  this  baseline  we  can  address  the  question  to  what 
extent  does  training  improve  petformance  over  and  above  guessing. 

Agent's  Knowledge 

The  agent's  knowledge  consists  only  of  current  information  For  example,  only  the 
speed,  direction,  and  altitude  of  the  aircraft. 

Training  Procedure 

There  is  no  training  procedure.  The  agent  has  never  seen  any  of  the  problems 
before.  The  agent  has  been  given  no  guidance  on  how  to  proceed. 

Decision  Procedure 

Given  a  problem,  the  agent  simply  makes  a  random  guess.  This  procedure  is 
followed  whether  the  agent  has  complete  information  or  incomplete  information.  The  agent 
proceeds  as  though  simply  following  hunches.  Returning  to  the  radar  scenario,  this 
corresponds  to  a  situation  where  all  the  agents  are  simply  placed  in  front  of  a  series  of 
surveillance  systems,  with  no  prior  experience  and  told  OK  tell  me  is  that  aircraft  out  there 
friendly,  neutral  or  hostile.  The  untrained  agents  in  this  situation  will  simply  throw  up  their 
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hands  and  guess  or  toss  a  three-sided  coin. 

Experientiallv-Trained  Procedure 

In  the  experiential  condition,  the  agents  have  historical  information  on  which  they 
base  their  recommendation.  The  experientially  trained  agents  are  fully-trained  agent  in  the 
sense  that  they  have  previously  encountered  all  possible  aircraft  and  have  received  feedback 
on  each  aircraft.  The  experientially  trained  agents  follow  the  decision  procedure  identified 
below  but  they  no  longer  alter  their  memory.  Thus,  their  expectations  remain  fixed. 

This  condition  is  interesting  as  it  represents  agents  who  are  empowered  to  act  on  the 
basis  of  their  own  assessment  of  the  situation.  Agents  proceed  as  though  they  are 
following  a  historical  dominance  rule.  That  is,  the  agent  after  having  classified  an  aircraft 
will  make  the  decision  that  has  been  the  historically  dominant  (most  often  correct  in  the 
past).  This  corresponds  to  a  situation  where  all  the  agents  placed  in  front  of  a  series  of 
surveillance  systems  have  extensive  prior  experience  and  are  told  OK  tell  me  is  that  aircraft 
out  there  friendly,  neutral  or  hostile.  Unlike  the  untrained  agents,  who  in  this  situation  will 
simply  throw  up  their  hands  and  guess,  the  experientially-trained  agent  will  say  well,  in  my 
e.xperience.  when  this  particular  pattern  appeared  on  my  equipment,  the  aircraft  out  there 
was  typically  ... 

Agent's  Knowledge 

In  this  scenario,  each  agent's  memor>'  contains  a  record  of  the  types  of  aircraft  seen 
during  the  training  period  and  the  number  of  aircraft  of  each  type  that  were  truly  friendly, 
neutral,  or  hostile.  Aircraft  types  are  defined  by  the  pattern  of  observed  characteristics. 
For  example,  for  one  agent,  a  type  of  aircraft  might  be  high  speed,  long  range,  and  radar 
emission  of  type  weapons.  The  number  of  types  of  aircraft  that  an  agent  who  can  observe 
three  pieces  of  information  is  3^,  such  that  N  is  the  number  of  pieces  of  information  that 
the  agent  has  access  to  when  working  on  the  sub-task. 

Training  Procedure 

During  training,  each  agent  sees  each  of  the  19683  possible  aircraft,  is  asked  to 
provide  a  recommendation,  and  is  given  feedback.  The  decision  procedure  followed 
during  training  is  the  same  as  that  followed  after  training,  what  differs  is  the  information 
that  informs  that  procedure.  The  feedback  provided  to  the  agent  is  the  true  state  of  the 
aircraft  (based  on  the  objective  definition).  This  feedback  is  the  same  for  all  agents  in  the 
organization  regardless  of  their  position  and  does  not  depend  on  what  the  agent  has  done  or 
should  have  done. 

Let  us  consider  how  the  agent  learns.  The  agent  begins  knowing  nothing,  and  like 
the  untrained  agent  previously  described  will  start  out  by  just  guessing.  As  the  agent  sees 
each  of  the  possible  types  of  aircraft,  his  or  her  memory  of  the  frequency  with  which  that 
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set  of  problem  characteristics  is  associated  with  that  true  outcome  is  augmented.  By  the 
end  of  training  each  agent  has  seen  all  possible  aircraft  and  has  a  memory  of  the  frequency 
with  which  aircraft  of  a  panicular  type  are  friendly,  neutral,  or  hostile.  Since  different 
agents  observe  different  characteristics,  their  memories  will  be  slightly  different.  This  is 
the  same  procedure  followed  in  the  experiential  learning  model  employed  by.  and  described 
in  detail  by.  Carley  (1990,  1991a.  1992). 

Decision  Procedure 

Each  agent  makes  decisions  only  on  the  basis  of  his  or  her  historical  experience. 
The  decision  procedure  varies  slightly  depending  on  whether  the  agent  has  complete  or 
incomplete  information. 

Com  pi  ere  Information 

When  the  agent  has  complete  information,  the  agent  first  classifies  the  aircraft  on 
the  basis  of  the  characteristics  he  or  she  observes.  The  agent  looks  up  in  his  or  her 
historical  record,  how  often  for  that  type  the  true  decision  was  a  friendly,  neutral  or  hostile. 
Let  us  call,  the  number  of  times  that,  for  a  panicular  type,  the  true  decision  was  "x",  the 
expectation  of  "x".  The  decision  procedure  is  described  as  follows; 

If  the  expectation  of  a  friendly  aircraft  is  greater  than  the  expectation  of  either  a 
neutral  or  a  hostile  aircraft  given  that  sub-task,  the  agent  reports  that  the  aircraft 
is  friendly. 

If  the  expectation  of  a  neutral  aircraft  is  greater  than  the  expectation  of  either  a 

friendly  or  a  hostile  aircraft  given  that  sub-task,  the  agent  repons  that  the  aircraft 
is  neutral. 

If  the  expectation  of  a  hostile  aircraft  is  greater  than  the  expectation  of  either  a 
friendly  or  a  neutral  aircraft  given  that  sub-task,  the  agent  reports  that  the 
aircraft  is  hostile. 

If  neutral  and  hostile  aircraft  are  equally  likely  and  both  greater  than  friendly 
aircraft,  then  the  agent  randomly  chooses  either  neutral  or  hostile  aircraft. 

If  friendly  and  hostile  aircraft  are  equally  likely  and  both  greater  than  friendly 
aircraft,  then  the  agent  randomly  chooses  either  friendly  or  hostile  aircraft. 

If  neutral  and  hostile  aircraft  are  equally  likely  and  both  greater  than  friendly 
aircraft,  then  the  agent  randomly  chooses  cither  neutral  or  hostile  aircraft. 

If  friendly,  neutral,  and  hostile  aircraft  are  equally  likely,  then  the  agent  randomly 
chooses  either  friendly,  or  neutral,  or  hostile. 

By  following  this  procedure  the  agent  is  acting  as  though  it  has  perfect  recall."  As 
the  agent  has  no  way  to  determine  the  "correctness"  of  the  information,  this  procedure  is 
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followed  whether  or  not  the  information  acquired  by  the  agent  is  correct.  Since  the  agent 
can  not  discriminate  between  correct  and  incorrect  information,  if  the  information  is 
incorrect  then  the  agent  will  simply  misclassify  the  aircraft.  For  example,  the  agent  might 
think  it  is  looking  at  an  aircraft  of  type  ”a"  when  it  in  reality  is  looking  at  an  aircraft  of  type 
"b".  As  a  result,  the  agent  recalls  the  expectations  for  aircraft  of  type  "a"  and  not  "b",  and 
acts  on  these. 

Incomplete  Information 

Incomplete  information  might  occur  because  the  radar  detection  system  does  not 
function  well,  or  an  analyst  is  off-line,  or  a  communication  channel  is  broken.  When 
information  is  incomplete,  the  agent  can  not  uniquely  classify  an  aircraft.  Instead,  the  agent 
matches  only  that  information  available  (panial  pattern  matching).  This  may  result  in  the 
selection  of  3  or  more  types.  Then,  for  each  selected  type,  the  agent  sums  up  the 
expectations  of  friendly  in  ail  types,  neutral  in  all  types,  and  hostile  in  all  types  and  acts  on 
the  basis  of  the  combined  expectations  following  the  procedure  previously  dictated. 
Operationally-Trained  Scenario 

In  the  operational  condition,  the  agents  have  standard  operating  procedures  (SOPs) 
on  which  they  base  their  recommendation.  Agents  are  considered  fully-trained  as  they  have 
perfect  knowledge  of  the  SOP  and  employ  it  without  error. 

This  condition  is  interesting  as  it  represents  agents  who  are  expected  to 
mechanically  follow  accepted  procedure.  The  SOP  chosen  is  such  that  the  agent  acting 
purely  on  the  basis  of  the  criticality  of  his  or  her  local  current  information.  History,  has  no 
effect.  The  SOP  decision  procedure  is  such  that  agents  proceed  as  though  they  were 
following  a  local  dominance  rule;  i.e.,  they  make  the  decision  that  appears  most  correct 
given  just  the  agent’s  current  knowledge.  This  corresponds  to  a  situation  where  all  of  the 
agents  are  placed  in  front  of  a  series  of  surveillance  systems,  and  told  OK  report  whether 
that  aircraft  out  there  friendly,  neutral  or  hostile.  Unlike  either  the  untrained  agent  or  the 
experientially-trained  agent,  the  operationally  trained  agent  will  say  well,  let's  plug  this  data 
in  to  the  SOP  and  the  answer  will  pop  out.  The  agents  in  this  case  are  following  orders 
blindly,  with  no  apparent  concern  for  the  consequences. 

Agent’s  Knowledge 

The  agent’s  knowledge  consists  of  current  information  and  the  standard  operating 
procedure. 

Training  Procedure 

All  agents  in  the  organization  are  told  the  standard  operating  procedure  which  they 
perfectly  memorize.  They  then  follow  the  procedure  automatically. 

Decision  Procedure 
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The  standard  operating  procedure  is: 

1 )  Sum  up  the  information  available  to  you  on  the  current  aircraft. 

2)  Categorize  this  sum.  The  categorization  procedure  followed  is  such  that  the  total 
number  of  cases  is  equally  divided  into  three  pans.  For  example,  for  three  pieces  of 
information,  the  sum  of  information  available  to  the  agent  ranges  from  3  to  9.  If  the  sum  is 
between  3  and  5  the  agent  is  to  classify  the  aircraft  as  friendly,  if  6  as  neutral,  and  if 
between  7  and  9  it  is  to  be  classified  as  hostile. 

3)  Make  as  your  recommendation/decision  the  category  into  which  the  sum  falls. 

In  practice,  this  operating  procedure  appears  slightly  different  if  the  agent  has 
complete  or  incomplete  information. 

Complete  Information 

The  agent,  given  information  on  an  aircraft,  simply  adds  the  values  of  all  the 
information,  and  reports  the  category  into  which  the  sum  falls. 

Incomplete  Information 

When  information  is  not  complete  —  due  to  either  missing  information,  or  other 
agent's  unavailability,  or  communication  channel  break  down  —  the  agent  adds  the 
remaining  known  information  and  reports  the  modified  category  that  the  sum  value  falls  in. 
The  category  is  modified  by  taking  the  total  number  of  cases  of  the  remaining  information 
and  dividing  it  equally  into  three  parts.  When  there  is  no  information  known,  the  agent 
simply  guesses  (in  this  case,  the  possible  decisions  1. 2.  and  3  are  equally  likely). 

STRESS 

We  examine  two  types  of  stress  —  maydays  and  murphies. 

Maydays 

Maydays  represent  crises  to  the  organization.  As  noted  earlier  they  are  stresses 
external  to  the  organization  (such  as  hostile  events).  This  is  similar  to  the  definition  of 
"stress"  provided  by  Staw  et  al.  (1981).  In  this  analysis,  those  aircraft  that  given  a 
panicular  task  definition  are  hostile  are  considered  maydays. 

Murphies 

Murphies  represent  stresses  or  crises  internal  to  the  organization.  As  noted  earlier 
they  are  internal  stress  (such  as  communication  channel  breakdown).  Murphies  are 
expected  to  create  internal  ambiguity  within  the  organization  (March  and  Simon,  1958).  In 
this  paper  we  examine  5  different  types  of  murphies  —  missing  information,  incorrect 
information,  agent  unavailability,  agent  turnover,  and  communication  channel  breakdown. 
These  types  of  murphies  were  chosen  because  they  are  prevalent  in  real  organizations  and 
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the  vary  in  terms  of  whether  the  represent  technology  based  ambiguity  (missing 
information  and  incorrect  information)  or  agent  based  ambiguity  (agent  unavailability  and 
agent  turnover)  or  ambiguity  due  to  some  technology-agent  interlink  (communication 
channel  breakdown). 

In  addition,  we  vary  the  degree  of  severity  of  such  murphies.  We  examine  three 
levels  of  severity  —  low  (1  murphy  occurs),  medium  (2  murphies  occur),  and  high  (3 
murphies  occur).  In  reality,  during  most  crises  multiple  murphies  of  different  types  occur. 
In  this  paper,  in  order  to  examine  the  differential  impact  of  different  types  of  murphies, 
only  a  single  type  is  examined  at  a  time.  Thus,  even  when  there  are  multiple  murphies  they 
are  all  of  the  same  type. 

For  each  organization,  the  location  of  the  one  or  more  murphies  is  chosen  randomly 
before  each  decision  cycle.  Thus,  a  technology  based  murphy  is  equally  likely  to  occur  for 
each  of  the  9  task  characteristics.  And  an  agent  based  murphy  (or  the  communication 
breakdown)  is  equally  likely  to  occur  for  each  analyst. 

Missing  Information 

Missing  information  is  defined  as  occurring  when  one  or  more  of  pieces  of  the 
incoming  information  for  a  particular  problem  is  not  available.  For  example,  the  altitude  of 
the  aircraft  may  not  be  detected  becau.se  certain  surveillance  equipment  is  broken. *- 
Incorrect  Information 

Incorrect  information  is  defined  as  occurring  when  incoming  information  is 
erroneous,  e.g.  when  the  radar  system  repons  an  aircraft  as  being  very  fast  when  indeed  it 
is  moving  slow.  This  can  happen,  for  example,  when  some  surveillance  equipment  does 
not  work  properly.’^ 

Agent  Unavailability 

Agent  unavailability  is  defined  as  occurring  when  one  or  more  analysts  is  not 
available  to  help  the  organization  solve  the  problem  and  so  does  not  repon  his  or  her 
decision  to  his  or  her  manager.  Agent  unavailability  frequently  results  in  erroneous 
organizational  decisions.  For  example,  this  can  happen  when  certain  operators  are  sick  and 
unable  to  be  on  duty.'** 

Communication  Channel  Breakdown 

A  communication  channel  breakdown  is  defined  as  occurring  when  one  or  more 
analysts  are  unable  to  report  to  a  superior  because  the  communication  channel  is 
unavailable.  This  can  be  thought  of  as  a  failure  in  the  communication  technology,  or,  as 
ignorance  of  the  necessity  of  communication.  For  example,  this  can  happen  when  some 
operators  do  not  report  their  observations  to  their  superiors. 

Agent  Turnover 
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Agent  turnover  is  defined  as  occurring  when  one  or  more  analysts  leave  the 
organization  and  are  replaced  by  a  new  analyst.  In  this  study,  new  analysts  in 
experientially-trained  organization  are  untrained,  and  do  not  learn,  and  so  proceed  simply 
by  guessing.  Turnover,  may  be  very  debilitating.  This  can  happen,  for  example,  when 
some  radar  operators  are  transferred  to  other  places  or  become  a  casualty  of  war,  and  new 
operators  take  over. 


PERFORMANCE  MEASURES 

Performance  is  defined  as  the  percentage  of  correct  decisions  made  by  the 
organization  given  a  set  of  problems  presented  to  the  organization.  Recall  that  an 
organization's  decision  is  considered  correct  if  the  final  decision  made  by  the  organization 
as  to  whether  the  aircraft  observed  during  that  time  period  was  friendly,  neutral,  and  hostile 
matches  the  true  nature  of  that  aircraft  given  the  objective  definition.  We  examine 
performance  relative  to  two  sets  of  problems  —  all  aircraft  and  maydays.  All  aircraft  — 
performance  is  measured  as  the  percentage  of  correct  decisions  made  by  the  organization 
given  all  19683  ca.ses.  This  measure  provides  an  indicator  of  the  overall  organizational 
performance.  Maydays  —  performance  is  measured  as  the  percentage  of  correct  decisions 
made  by  the  organization  given  all  hostile  aircraft  (recall  the  number  of  hostile  cases 
depends  on  the  task).  This  measure  provides  an  indicator  of  organizational  performance 
under  external  stress.  Mistakes  under  this  condition  have  severe  repercussions  (e.g..  the 
team  might  lose  the  war). 


EXPERIMENTAL  DESIGN 

A  series  of  simulations  are  run  in  which  organizational  structures  (4),  task 
decomposition  schemes  (4),  training  scenario  (3),  and  type  of  task  (4)  are  varied. 
Combining  these  parameters  defines  192  unique  organizational  types.  The  performance  of 
each  organizational  type  was  calculated  under  both  optimal  operating  conditions  (no 
murphies)  and  under  each  of  the  suboptimal  internal  stress  conditions  (one  or  more 
murphies).  There  are  20  such  conditions  (4  levels  of  severity,  including  "no"  murphies, 
and  5  types  of  murphies).  Thus,  we  examine  192  organizational  types  under  20  operating 
conditions  (5  optimal  and  15  suboptimal)  for  a  total  of  3840  cases. 

This  experiment  is  for  the  most  part  an  exercise  in  numerical  estimation.  We 
consider  all  possible  problem  scenarios  (all  aircraft)  in  each  case.  The  only  Monte-Carlo 
aspect  is  when  there  are  murphies,  the  location  of  each  Murphy  is  randomly  chosen  each 
time  period. 
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RESULTS 


Baseline 

We  use  as  a  baseline  the  case  when  all  agents  are  untrained  (and  so  act  only  on  their 
hunches)  and  are  faced  with  optimal  operating  conditions  (no  murphies).  Under  this 
circumstance,  all  organizations  (regardless  of  task,  structure,  or  task  decomposition 
scheme)  under  all  conditions  (maydays  or  muiphies)  make  the  correct  decision  33.33%  of 
the  time.  When  an  agent  guesses  he  or  she  is  equally  likely  to  decide  that  the  aircraft  is 
friendly,  neutral  or  hostile.  Thus,  the  chance  of  the  agent  making  a  correct  decision  is  1/3. 
In  the  team  with  voting,  since  majority  rule  is  used,  and  since  there  are  9  analysts  voting, 
since  the  probability  of  each  one  giving  the  correct  answer  is  1/3  and  since  all  agents  are 
independent,  the  probability  that  the  overall  vote  will  be  correct  is  also  simply  1/3.  In  all 
other  organization's  there  is  a  CEO.  For  the  CEO  the  input  of  subordinates  to  supervisors 
is  irrelevant  as  the  CEO  no  matter  what  he  or  she  is  told  will  simply  guess.  For  the 
untrained  organizations  stress  (either  internal  or  external)  does  not  affect  performance. 

Had  there  been  only  two  choices,  as  in  the  experimental  learning  model  examined 
by  Carley  (1990,  1991a.  1991b,  1992).  the  baseline  performance  would  have  been 
50.00%.  There  are  two  points  here.  First,  as  a  baseline,  when  the  organization  must 
choose  between  a  set  of  options,  the  minimum  acceptable  perfonnance  is  simply  1  over  the 
number  of  options.  Second,  any  performance,  if  less  than  this  minimum,  is  unacceptable 
as  organizational  performance  could  be  improved  by  simply  guessing. 

General  Behavior 

Generally,  training  improves  performance  (see  Table  1).'^  Overall,  organizations 
employing  experientially  trained  agents  tend  to  outperform  those  employing  agents  trained 
to  follow  SOPs  and  both  outperform  organizations  where  agents  are  simply  guessing.  This 
tends  to  be  true  whether  the  organization  is  operating  under  optimal  or  suboptimal 
conditions,  and  whether  or  not  they  are  faced  with  maydays.  The  average  perfonnance  of 
all  organizations  with  experiential  training  (59.93),  regardless  of  the  operating  conditions  is 
significantly  higher  than  the  average  performance  of  organizations  with  operational  training 
(54.56)  (t=9.4,  df  =  1279,  p  <  .001).  Both  are  significantly  higher  than  the  baseline. 

***Place  Table  1  about  here*** 

When  type  of  task  is  considered,  experientially  trained  organizations  outperform 
operationally  trained  organizations  for  biased  tasks;  whereas  operationally  trained 
organizations  do  better  on  unbiased  tasks.  Agent  experience  serves  them  best  when  the 
preponderance  of  their  experience  is  in  the  same  area  (in  this  case  hostile  tasks). 
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***Place  Table  2  about  here*** 

Across  all  conditions,  the  top  performing  experientially  trained  organization  is  the 
team  with  voting,  with  a  segregated  scheme  (mean=66.76,  stderr=1.79,  n=80),  and  the 
bottom  performing  organization  is  the  team  with  manager  with  an  overlapped  scheme 
(mean=54.69,  stderr=2. 10,  n=80).  Across  all  conditions,  the  top  performing  operationally 
trained  organization  is  the  hierarchy  with  a  distributed  scheme  (mean=56.28,  stderr=1.05, 
n=80).  and  the  bottom  performing  organization  is  the  hierarchy  with  a  segregated  scheme 
(mean=52.16,  stderr=1.20,  n=80).  Regardless  of  the  type  of  training,  which 
organizational  types  appear  as  the  best  and  worse  performers  depends  on  the  specific  task 
environment.  In  fact,  for  the  experiential  organization  the  best  performing  organization 
becomes  the  matrix  with  a  blocked  scheme  (mean=86.04.  stderr=1.05,  n=20)  when  facing 
bia.sed  non-decomposable  task,  and  the  worst  performing  organization  becomes  the  team 
with  manager  with  a  segregated  scheme  when  facing  an  unbiased  non-decomposable  task 
(mean=33.29.  stderr=0.65,  n=20).  Whereas,  in  the  operational  organization,  the  best 
performing  organization  becomes  the  team  with  manager  with  a  segregated  scheme 
(mean=79.39,  stderT=4.07.  n=20)  when  facing  an  unbiased  decomposable  task,  and  the 
worst  performing  organization  becomes  the  team  with  manager  with  a  segregated  scheme 
when  facing  a  biased  non-decomposable  task  (mean=43.01,  stderr=0.67.  n=20). 

Generally,  organizations  perform  better  under  maydays  than  they  do  across  all 
external  conditions  regardless  of  the  type  of  training  (see  Tables  1  and  2).  This  is  good 
news  for  managers,  as  it  suggests  that  when  it  really  matters  organizations  will  benefit  from 
the  effort  they  have  expended  on  training.  Organizations  that  employ  experientially  trained 
personnel,  under  optimal  operating  conditions,  can  exhibit  perfect  performance  when  faced 
with  maydays.  For  example,  in  the  most  realistic  environment  (biased,  non-decomposable) 
as  long  as  the  organization  does  not  have  a  blocked  task  decomposition  scheme  the 
experientially  trained  organization  makes  the  right  decision  every  time  (mean=  100.00, 
stderr=0.00,  n=20).  However,  if  the  organization  employs  operationally  trained 
personnel,  the  same  organizational  structure  (e.g.,  a  team  with  a  manager  and  a  segregated 
task  decomposition  scheme)  may  exhibit  much  worse  performance  (mean=42.28, 
stderr=0.86,  n=20)  even  given  the  same  task  environment. 

Finally,  on  average,  as  the  number  of  simultaneous  murphies  increases 
organizational  performance  degrades  (see  Figure  5'*).  This  degradation  is  non-linear. 
Also,  when  the  organization  is  operationally  trained  and  the  task  is  biased  then  the 
occurrence  of  a  single  murphy  may  actually  improve  performance.  For  experientially 
trained  organizations,  murphies  on  average  degrade  performance  (optimal  conditions  mean 
=  62.18,  stderr=0.96,  n=320  and  suboptimal  conditions  mean  =  59.18.  stderr=0.55. 
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n=960).  This  difference  is  significant  (t  =  2.71,  df  =  319.  p  <  .005).  Similarly,  for 
operationally  trained  organizations,  murphies  degrade  performance  (optimal  conditions 
mean=57.29,  stderr=0.75,  n=320  and  suboptimal  conditions  mean=53.66,  sideiT=0.33, 
n=960).  This  difference,  too,  is  significant  ( t  =  4.43,  df  =  319,  p  <  .0005).  When  faced 
with  maydays,  murphies  also  degrade  organizational  performance  (optimal  conditions 
mean=96.63,  stderr=0.43.  n=320  and  suboptimal  conditions  mean=91.30,  stderr=0.43, 
n=960).  This  difference  is  significant  (  t  =  9.10,  df  =  319,  p  <  .0005).  Similarly,  for 
operationally  trained  organizations,  murphies  degrade  performance  (optimal  conditions 
mean=72.92,  stderr=0.98,  n=320  and  suboptimal  conditions  mean=68.98,  siderr=0.51. 
n=960).  This  difference  is  significant  (  t  =  3.94,  df  =  319,  p  <  .0005).  Experientially 
trained  organizations  under  suboptimal  conditions,  across  all  external  conditions  and  when 
faced  with  maydays,  outperform  operational  organizations  under  optimal  conditions.  As  a 
final  point,  particularly  for  the  experiential  organization,  type  of  task  environment  has  a 
stronger  effect  on  performance  than  does  the  number  or  type  of  murphies,  which  is  also 
shown  in  Table  2. 

***Place  Figure  5  about  here*** 

In  summary,  we  have  observed  four  general  patterns:  training  improves 
performance,  empowering  agents  to  follow  their  experience  rather  than  SOPs  leads  to  better 
performance,  organizations  faced  with  maydays  exhibit  better  performance  than  they  do 
across  all  external  conditions,  and  as  the  number  of  murphies  increases  performance 
decreases.  These  panicular  patterns  tend  to  be  true  regardless  of  the  task  environment. 
However,  the  specific  level  of  performance  and  which  organization  performs  best  or  worse 
when  varies  with  the  task  environment. 

Murphies 

In  general,  technologically  based  murphies  are  more  debilitating  than  are  people 
based  murphies  (see  Figure  6*^).  Mis-information  is  thus  worse  for  the  organization  than 
communication  breakdowns.  However,  if  the  organization  is  experientially  trained  then 
agent  turnover,  on  average,  degrades  the  performance  most  from  performance  under 
optimal  conditions  (mean=56.10,  stderr=1.09,  n=256).  In  operationally  trained 
organizations  turnover  has  less  effect  and  incorrect  information  degrades  the  performance 
the  most  from  performance  under  optimal  conditions  (mean=49.80,  stderT=0.60,  n=256). 

A  similar  pattern  emerges  under  maydays.  Technologically  based  murphies  are  still 
generally  more  debilitating  than  are  people  based  murphies  (see  Figure  6).  Although,  if  the 
organization  is  experientially  trained  agent  can  be  as  bad  or  worse  than  technologically 
based  murphies.  Further,  if  the  task  is  biased  and  decomposable,  then  turnover  has  the 
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biggest  effect  on  the  experiential  organization.  When  faced  with  maydays  the  organization 
may  find  murphies  to  have  a  greater  affect  than  they  do  across  all  external  conditions.  Thus 
while  task  type  is  important  generally  in  dictating  performance  level,  under  maydays 
muiphies  may  appear  more  imponant. 

***Place  Figure  6  about  here*** 


Design 

General  behavior 

The  following  four  figures  show  how  organizations  with  different  structures  and 
task  decomposition  schemes  perform  under  optimal  operating  conditions-®.  We  first 
consider  experientially  trained  organizations.  On  average  (across  all  external  conditions) 
the  team  with  voting  structure  generally  exhibits  the  highest  level  of  performance, 
particularly  when  the  task  is  unbiased  (Figure  7).  When  the  task  is  non-decomposable. 
organizations  with  blocked  or  distributed  task  decomposition  schemes  outperform 
organizations  with  less  redundant  schemes.  This  suggests  that  when  the  task  requires 
integration  of  information  redundancy  in  information  access  helps.  In  this  sense, 
individuals  are  better  than  the  organization  at  integrating  information. 

***  Place  Figure  7  about  here  *** 

Now  consider  the  operationally  trained  organization  under  the  same  conditions 
(Figure  8).  In  this  case  the  team  with  voting  is  still  one  of  the  better  performing 
organizations.  However,  as  can  be  seen  by  contrasting  Figure  7  and  8,  the  performance  in 
operationally  trained  organizations  is  lower.  Operational  training  tends  to  decrease 
differences  due  to  organizational  structure  and  task  decomposition  scheme.  This  can  be 
seen  in  the  relative  flatness  of  the  drawings  in  Figure  8  as  compared  tot  hose  in  Figure  7. 
Training  personnel  to  follow  SOPs  thus  reduces  the  reliance  of  the  organization  on  its 
structure  and  scheme.  This  is  particularly  important  for  organizations  that  might  expect  to 
have  rapidly  changing  designs  such  as  might  occur  in  response  to  rapid  turnover.  If  such 
an  organization  follows  SOPs  then  switching  design  may  cause  less  damage  in 
performance  than  if  the  organization  allows  the  agents  to  follow  their  own  historical 
information. 

***  Place  Figure  8  about  here  *** 

So  far  we  have  been  considering  performance  overall.  What  happens  if  the 
organization  is  faced  with  maydays?  In  this  case,  in  the  experiential  organization  (Figure  9) 
organizational  performance  has  improved  to  the  point  where  the  exact  structure  and  task 
decomposition  scheme  chosen  are  less  critical.  In  fact,  in  the  simplest  task,  the  biased 
decomposable  task,  all  organizations  do  perfectly.  Otherwise,  organizational  designs  with 
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more  redundancy,  either  in  structure  or  scheme,  tend  to  be  slightly  better  performers. 
Contrasting  Figures  7  and  9  we  see  that  while  such  redundancy  may  be  a  hindrance  on 
average  it  helps  in  the  critical  cases.  Such  redundancy  reduces  performance  on  average  due 
to  the  collapse  in  information  in  the  more  hierarchical  structures  and  due  to  the  potentially 
greater  disagreement  in  opinions  in  the  more  redundant  schemes.  When  faced  with 
maydays,  however,  the  incoming  information  is  in  a  sense  more  consistent.  Thus,  there  is 
less  difference  in  information  to  get  collapsed  away  by  the  structure  and  less  possibility  of 
disagreement  in  opinions  particularly  when  the  scheme  is  more  redundant.  Where 
redundancy  works  against  the  organization  on  average  it  works  for  it  in  the  case  of  external 
crises. 

***  Place  Figure  9  about  here  *** 

For  the  operational  organization  faced  with  maydays  (Figure  10)  redundancy  is  less 
important.  As  in  the  overall  case  (Figure  8)  following  SOPs  reduce  reliance  on 
organizational  design.  However,  following  SOPs  also  reduce  the  benefits  that  the 
organization  can  derive  from  redundancy  when  the  organization  is  faced  with  maydays. 
When  SOPs  must  be  followed,  decreased  differences  in  information  are  less  important  to 
the  organization. 

***  Place  Figure  10  about  here  *** 

In  general,  organizations  perform  better  when  facing  maydays  than  they  do  on 
average.  The  organization  with  a  team  with  voting  structure  and  a  segregated  task 
decomposition  scheme  outperforms  other  organizational  forms  in  general.  But  when  faced 
with  maydays  or  when  operationally  trained,  organizations  with  matrix  structure  and 
distributed  task  decomposition  scheme  generally  perform  better.  Under  optimal  operating 
conditions  (no  murphies)  teams  with  voting  outperform  other  structures  as  long  as  the  task 
is  unbiased  and  decomposable,  which  suggest  such  organizational  structure  may  be  better 
to  balance  all  the  factors  and  make  less  biased  decisions.  This  confirms  the  result  reported 
by  Carley  (199 la,  1992).  Further,  this  is  true  whether  the  organization  is  employing 
decision  makers  who  make  decisions  following  their  own  experience  (Table  3)  or  SOPs 
(Table  4).  However,  as  can  be  seen  in  Tables  3  and  4,  teams  with  voting  are  not  better  in 
all  circumstances.  In  fact,  in  what  one  might  consider  the  most  common  real  world 
situation,  a  biased  non-decomposable  task  environment,  teams  with  voting  exhibit  the 
worst  performance.  As  a  final  point  in  examining  Tables  3  and  4,  it  appears  that  under 
maydays  organizations  to  exhibit  high  performance  require  slightly  more  management  and  a 
more  complex  task  decomposition  structures  unless  the  task  is  one  of  the  simpler  tasks  — 
the  unbiased  decomposable  task.  For  this  task  the  simplest  organizational  form  teams  with 
voting,  with  segregated  scheme  appear  to  be  the  best  performer.  These  findings  suggest 


22 


that  there  may  be  a  relationship  between  complexity  and  performance. 

***Place  Tables  3  and  4  about  here*** 

Complexity 

Given  the  organizational  structure  and  the  task  decomposition  scheme,  we  can 
define  a  measure  of  organizational  complexity.  This  measure  is  useful  as  it  will  allow  us  to 
examine  whether  more  complex  organizations  are  needed  to  deal  with  more  complex  tasks. 
We  define  organrzational  complexity  as:  (a)  simple  organization  —  an  organization  with 
either  a  team  with  voting  or  a  team  with  a  manager  structure  and  a  segregated  or  an 
overlapped  task  decomposition  scheme;  (b)  complex  organization  —  an  organization  with 
either  a  hierarchical  or  a  matrix  structure  and  a  blocked  or  a  distributed  task  decomposition 
scheme;  (c)  moderate  organization  —  all  other  organizations. 

Task  complexity  is  defined  by  its  decomposability  and  biasness.  A  biased  task  is 
simpler  than  an  unbiased  one  and  a  decomposable  task  i«  simpler  than  a  non-decomposable 
one.  Thus,  we  also  have  three  levels  of  complexity  for  task:  (a)  simple  task  -  a  biased 
decomposable  task;  (b)  complex  task  -  an  unbiased  non-decomposable  task;  (c)  moderate 
task  --  all  other  tasks. 

Using  these  measures,  we  can  determine  whether  there  is  a  match  between  the 
organizational  compie.xity  and  ta.sk  complexity.  A  poor  match  occurs  if  an  organization  is 
complex  and  a  task  is  simple,  or  if  an  organization  is  simple  and  a  task  is  complex;  a  perfect 
match  occurs  if  an  organization  is  simple  and  a  task  is  simple,  or  if  an  organization  is 
complex  and  a  task  is  complex,  or  if  an  organization  is  moderate  and  a  task  is  moderate;  a 
moderate  match  occurs  in  all  other  cases. 

The  average  performance  at  each  level  of  match  between  organizational  complexity 
and  task  complexity  is  shown  in  Table  5.  The  result  indicates  that  overall,  performance 
improves  as  the  level  of  match  increases.  Complex  organizations  tend  to  help 
organizational  performance  when  facing  complex  tasks  and  simple  organizations  tend  to 
help  organizational  performance  when  facing  simple  tasks,  regardless  of  training  scenario. 
This  confirms  the  observation  by  Siaw  et  al.  (1981).  However,  we  find  that  the  opposite  is 
true  in  one  case  -  when  the  organization  is  operationally  trained  and  facing  maydays.  This 
indicates  that  for  operationally  trained  organizations,  some  redundancy  in  structure  helps 
organizational  decision  making  performance  under  hostile  external  conditions. 

***Place  Table  5  about  here*** 

DISCUSSION 

In  this  analysis  we  have  focused  on  performance  under  friendly  external  conditions, 
as  we  treat  type  I  and  type  II  errors  as  being  equally  important  Under  friendly  external 
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conditions  (bias  toward  friendliness),  organizational  performance  would  tend  to  have  a 
complementary  pattern  as  hostile  external  conditions.  In  this  sense,  friendly  and  hostile 
conditions  are  mirror  conditions  in  our  model. 

While  we  have  begun  to  examine  the  effect  of  training  we  have  limited  ourselves  to 
training  that  was  largely  "helpful".  That  is,  agents  were  trained  in  the  same  type  of 
organization  for  which  their  performance  was  measured  and  the  SOPs  were  generally  of  the 
"right"  type.  Nevertheless,  this  model  does  indicate  that  organizations  where  agents 
received  the  wrong  training  may  actually  perform  worse  than  totally  untrained 
organizations.  For  example,  organizations  trained  for  a  biased  task  when  faced  with 
friendly  aircraft  can  do  better  by  just  guessing.  This  suggests,  for  example,  that  radar 
groups  trained  during  peacetime,  on  predominantly  civilian  aircraft,  when  put  in  a  combat 
situation  may  actually  do  worse  than  a  group  who  never  trained.  This  suggests  that 
training  does  not  transfer  to  novel  situations.  We  can  apply  this  result  to  the  Iranian  airline 
incident,  where  the  group  was  trained  in  an  environment  where  most  events,  albeit 
hypothetical,  were  hostile.  TTiey  were  trained  for  war.  But  they  were  faced  with  a  non¬ 
mayday.  Our  model  would  predict  they  are  likely  to  make  a  mistake  —  which  they 
apparently  did.  To  investigate  this  issue  of  the  extent  to  which  training  transfers  between 
situations  a  more  realistic  model  of  human  problem  solving  and  memory  may  be  needed. 

A  third  caveat  is  that  this  study  proceeded  by  using  a  stylized  radar  task,  numerical 
enumeration,  and  computer  simulation.  Compared  with  experiments  using  human 
subjects,  computer  simulations  are  easier  to  control,  more  flexible,  more  objective,  with 
less  noise,  and  thus  can  examine  more  factors  within  less  time.  As  pointed  out  by  Ostrom 
(1988),  computer  simulation  offers  a  third  symbol  system  in  studying  social  science, 
besides  natural  language  and  mathematics,  because  "computer  simulation  offers  a 
substantial  advantage  to  social  psychologists  attempting  to  develop  formal  theories  of 
complex  and  interdependent  social  phenomena".  Computer  simulations  are  limited  by  the 
simplified  assumptions,  as  well  as  the  computer  technologies.  Such  simulations  do  not 
always  capture  difference  due  to  individual  cognition.  Thus,  when  facing  a  task  requiring 
more  subjective  judgments,  our  model  may  need  to  be  modified.  Nevertheless,  these 
simulation  experiments  provide  a  series  of  hypotheses  which  we  can  test  both  with  human 
experiments  and  by  using  real  organizational  data.  Since  human  experiments  are  costly  to 
run,  and  it  is  often  difficult  to  obtain  large  quantities  of  data  on  real  organizations,  these 
simulation  experiments  help  us  develop  organizational  theory  and  determine  which 
parameters  are  most  important  to  explore  in  other  settings. 

Finally,  there  are  several  interesting  issues  that  are  suggested  by  our  analyses  that 
are  not  addressed  in  this  paper.  First,  different  training  orientations  such  as  training  for 
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friendly  environments  may  affect  performance.  Thus,  it  would  be  important  to  develop  a 
better  understanding  of  how  training  in  situation  "x"  affects  performance  in  situation  "y". 
Second,  it  is  often  suggested  that  organizations  when  faced  with  external  crises  or 
maydays,  should  restructure  themselves.  This  study  does  suggest  that  the  structure  that  is 
best  under  maydays  may  not  be  the  best  in  general;  however,  it  does  not  provide  insight 
into  whether  the  process  of  shifting  structures  would  degrade  organizational  performance. 
Further  studies  should  examine  whether  this  restructuring  is  beneficial  given  that  personnel 
were  trained  on  the  old  (non-mayday)  structure.  Third,  it  is  often  shown  that  under  time 
pressure,  performance  degrades.  In  this  study  the  aircraft  examined  were  effectively 
holding  still  and  so  time  pressure  was  not  an  issue.  Further  studies  should  examine  how 
time  pressure  will  affect  the  performance  of  organizations  given  the  presence  of  murphies 
and  maydays.  Finally  ,  many  measures  of  organizational  design  have  been  proposed  which 
are  expected  to  be  able  to  predict  organizational  performance  (e.g.,  Mackenzie,  1978; 
Krackhardt,  1989).  Rarely  have  they  been  tested  and  contrasted.  The  formal  framework 
we  used  in  this  paper  provides  a  testbed  for  doing  this.  We  are  engaged  currently  in  a  study 
using  this  framework  to  examine  how  well  these  measures  are  able  to  predict  performance 
(Lin  and  Carley.  1991). 


CONCLUSION 

We  have  considered  the  inter-relationship  between  organizational  design,  task,  and 
stress  relative  to  organizational  performance.  These  results  confirm  those  found  by  Carley 
(1991a,  1992):  training  improves  performance,  the  greater  the  severity  of  the  internal  crisis 
(more  murphies)  the  lower  the  performance,  turnover  degrades  performance, 
misinformation  leads  to  lower  performance  than  communication  breakdowns,  and  teams 
outperform  hierarchies.  Such  replication  indicates  that  such  results  are  a  product  of  the 
organizational  design  and  environment  and  not  the  number  of  choices  available  to  the 
agents  when  making  decisions.  However,  our  results  do  more  than  just  replicate  these 
earlier  studies.  They  also  place  these  earlier  results  in  a  broader  context  and  show 
limitations  to  these  findings.  Let  us  consider  two  of  these  —  that  turnover  degrades 
performance  and  that  teams  outperform  hierarchies. 

Turnover  degrades  performance,  but  the  effect  may  be  minimal  and  even  appear 
non-existent  when  agents  are  trained  to  follow  SOPs.  In  experientially  trained 
organizations,  turnover  can  be  even  more  debilitating  than  technological  murphies. 
However,  in  an  operationally  trained  organization  turnover  matters  less.  Thus, 
organizations  which  can  not  rely  on  SOPs  should  expand  more  effort  to  retain  personnel, 
and  to  hire  trained  personnel.  Organizations  that  employ  SOPs  need  to  worry  less  about 
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personnel  relations. 

As  to  the  second  point,  teams  outperform  hierarchies  —  but  they  do  so 
predominantly  when  the  task  is  unbiased  decomposable.  In  a  biased  task,  when  one 
outcome  is  more  likely  than  others,  or  a  non-decomposable  task,  when  the  interrelationship 
between  information  is  complex,  more  complex  organizational  structures  outperform 
teams.  We  found  that,  in  general,  when  facing  complex  tasks,  complex  organizations  tend 
to  help  performance,  but  when  facing  simple  tasks,  simple  organization  tend  to  help 
performance  instead,  regardless  of  external  stress  and  training  scenarios.  However,  when 
the  organizations  face  maydays  the  opposite  seems  to  be  the  case.  These  results  suggest 
that  task  complexity  and  external  situation  are  stronger  determinants  of  performance  than 
either  organizational  design  or  murphies.  Thus,  the  organization  should  first  expend  effon 
determining  what  tasks  and  external  situations  they  are  likely  to  face  before  settling  on  a 
particular  organizational  design  or  expending  effort  to  minimize  murphies. 

A  number  of  other  policy  implications  can  be  drawn  from  these  results.  Let  us 
consider  a  few  of  these.  While  turnover,  and  other  muiphies,  can  degrade  organizational 
performance,  the  effect  depends  on  the  type  of  training  received  by  organizational 
members.  In  general,  technological  murphies  are  more  debilitating  than  agent  based 
murphies,  which  means  most  organizations  with  limited  budget  should  spend  resources  to 
get  the  information  right  in  the  first  place.  As  the  number  of  simultaneous  murphies 
increases,  organizational  performance  decreases,  unless  organizational  members  are  trained 
to  follow  SOPs  and  are  facing  a  biased  task.  This  result  suggests  that  more  information 
does  not  necessarily  help  organizational  performance,  in  fact,  under  certain  conditions, 
organizations  can  benefit  from  less  information.  For  biased  tasks,  experientially  trained 
organization  exhibit  higher  performance  than  operationally  trained  organizations  overall, 
and  the  opposite  for  unbiased  tasks  overall.  Thus,  in  general,  organizations  that  are  unsure 
of  the  environment  (i.e.,  don't  know  if  it  is  biased  or  unbiased)  should  not  use  SOPs,  but 
should  experientially  train  their  employees  as  this  admits  maximum  adaptation.  If  the 
organization  knows  the  environment,  then  an  appropriate  SOP  is  generally  better.  But,  if 
the  organization  expects  and  needs  high  reliability  during  maydays,  then  SOPs  generally 
are  less  risky  as  an  incorrect  experiential  training  may  severely  hurt  organizational 
performance. 

This  study  addresses  many  imponant  policy  issues.  First,  this  study  shows  that  it 
is  important  to  evaluate  the  procedure  and  purpose  of  training.  Training  may  be  a  waste  of 
time  or  even  hurt  organizational  performance  without  being  properly  guided.  Second,  this 
study  demonstrates  that  more  information  does  not  always  result  in  better  decisions. 
Rather,  decision  making  performance  depends  on  the  training  procedure,  the  location  of 
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communication  links,  and  the  task  characteristics.  Thus,  organizations  should  be  very 
careful  expanding  or  altering  their  organizational  or  task  decomposition  structures  during 
crisis  situations.  Third,  this  study  suggests  that  there  is  a  strong  relationship  between 
stress  and  organizational  design.  Organizations  should  determine  what  type  of  stress  most 
affects  their  performance  before  spending  money  to  alleviate  stress,  as  many  types  of  stress 
will  have  little  impact.  Fourth,  this  study  indicates  that  task  is  extremely  critical  in  the 
determinants  of  organizational  decision  making  performance,  and  that  for  different  tasks, 
organizations  should  be  designed  accordingly  to  be  most  effective. 

Our  results  suppon  the  idea  that  the  best  design  is  contingent.  However,  we  have 
also  demonstrated  that  by  using  a  framework  containing  elements  of  open  system  theory, 
structuralism,  resource  dependency,  and  institutionalism  we  can  begin  to  place  limits  on 
when  what  type  of  design  is  most  effective.  We  find  that  the  environment  places  limits  on 
performance  that  no  design  can  overcome  and  that  major  performance  improvements  can 
often  be  achieved  only  by  changing  the  nature  of  the  environment  in  which  the  organization 
operates. 


^Though  there  has  been  other  version  of  the  incident  recently,  we  still  use  this  version  to  illustrate 
the  point  to  be  addressed  in  this  paper. 

^Lin  and  Carley  (1991)  also  tested  and  contrasted  the  predictability  of  existing  measures  of 
organizational  design.  They  found  that  no  single  measure  predicted  performance  well  under  all  conditions 

^  We  also  examined  a  non-decomposable  rule  where  Sum  = 
F1*F2*F3+F.^+F4*F5*F6+F6+F7*F8*F9+F9.  This  rule  generates  results  similar  to  that  of  the  non- 
decomposable  rule  described.  The  fact  that  the  results  are  similar  suggests  that  decomposability  in  general 
is  more  of  a  problem  than  the  specific  type  of  decomposability. 

'^For  the  unbiased  decomposable  task  the  categorization  scheme  shown  in  Figure  2  is  only  an 
approximation.  We  funher  categorized  those  problems  whose  sum  equals  17.  such  that  some  are  friendly, 
and  others  are  neutral.  Similarly,  for  those  problems  whose  sum  is  19.  we  categorize  them  such  that  some 
are  hostile  and  others  are  neutral.  This  categorization  enabled  the  number  of  problems  in  each  category  to 
be  more  close  to  one  third  of  the  total  problems. 

^  One  could  relax  this  assumption  to  make  it  a  non-uniform  distnbution  by  assuming  that  certain 
problems  appear  more  than  others.  Adding  bias  in  that  fashion  would  not  change  the  results  but  it  would 
affect  the  rate  of  learning  with  which  we  are  not  concerned  in  this  study. 

^We  have  also  examined  an  alternative  matrix  structure,  in  which  only  six  of  the  nine  baseline 
analysts  report  to  two  managers,  while  the  3  remaining  analysts  report  to  a  single  manager.  The 
performance  of  organizations  with  this  structure  is  between  that  reponed  for  the  hierarchy  and  matnx. 

^Malone  (1986)  and  Carley  (1991 )  contrasted  the  performance  of  various  organizations. 


27 


^In  dealing  with  trinar\-  choices,  the  simple  majority  rale  has  to  be  slightly  modified. 

^The  task  decomposition  scheme  has  also  been  referred  to  as  the  information  access  stracture  (e.g. 
Carley.  1991a.  1992).  We  use  the  term  task  decomposition  scheme  to  (1)  emphasize  the  role  of  task  in 
organizational  performance,  and  (2)  to  clearly  differentiate  ties  between  people  and  data  (the  task 
decomposition  scheme)  and  tics  between  people  and  people  (the  organizational  structure). 

'0>Ve  also  examined  two  other  task  decomposition  schemes,  segregated-2  and  overlapped-2.  The 
segregated-2  case  differed  from  the  segregated  structure  shown  only  in  which  analyst  saw  which  specific 
characteristic.  Examining  this  scheme  enabled  us  to  determine  whether  the  exact  pattern  of  which  analyst 
secs  which  piece  of  information  matters.  The  results,  however,  are  close  to  the  segregated  scheme  examined 
in  this  paper  and  so  suggest  that  the  exact  order  of  information  is  not  highly  critical.  In  the  overlapped'2 
case,  each  analyst  has  access  to  three  pieces  of  information,  such  that  two  pieces  of  information  are  shared 
(overlapped)  with  the  next  analyst.  The  result  for  this  scheme  are  similar  to  the  simple  overlap  pattern 
examined  in  this  paper. 

*  *  As  a  further  exploration,  we  also  tried  a  probabilistic  approach  in  the  simulation  of 
expcricniially  trained  organizations.  The  probabilistic  approach  differs  in  that  the  agent  does  not  simply 
report  the  choice  with  the  highest  frequency,  but  can  report  any  of  the  three  choices  but  with  a  probability 
equal  lo  the  frequency  of  their  occurrence.  For  example,  if  the  distribution  of  decisions  as  truly  "friendly ". 
"neutral",  and  "hostile"  is  10.  .^0.  and  20.  then  the  agent  reports  "friendly"  10/60  of  the  time,  "neuual" 
.^0/60  of  the  time,  and  "hostile"  20/60  of  the  time.  The  results  showed  that  the  performance  of 
expcrientially  trained  organizations  using  this  probabilistic  approach  was  lower  than  that  when  the  agents 
used  perfect  recall,  and  slightly  lower  than  when  they  used  SOPs.  The  particular  performance  of 
organizations  with  different  structures  and  task  decomposition  schemes  was  essentially  just  scaled  down. 

Missing  information  is  a  problem  for  many  organizations.  For  example,  in  China,  lack  of 
information  on  the  dale  and  amount  of  rain  in  the  1991  season  left  the  land  unprepared.  The  counuysidc 
was  devastated  by  the  unexpected  flood. 

*  ^  Incorrect  information  frequently  results  in  costly  mistakes.  For  example,  the  failure  of  the  Nazi 
Germans  on  D-day  was  due.  at  least  in  part,  to  their  "information"  that  Caray  was  the  place  the  Allies 
would  invade  instead  of  Normandy.  Incorrect  information  detected  by  the  allied  uxxips  is  also,  at  least 
partially,  why  friendly  fire  resulted  in  the  cause  of  the  one  in  four  casualties  during  the  Gulf  war. 

For  example,  the  Americans  were  unprepared  when  the  Japanese  attacked  Pearl  Harbor,  in  pan. 
because  some  officers  were  on  leave. 

^^Prior  to  the  Challenger  accident  (Rogers  at  al..  1989)  there  was  communication  breakdown 
between  the  contractor  Thiokol  and  NASA  management,  resulting  in  information  about  the  0_ring  failing 
to  be  communicated.  Communication  breakdowns  are  also  quite  common  in  war-time  when  military  units 
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must  remain  radio  sileni  in  order  lo  preser%e  their  secrecy. 

For  example,  in  the  chemical  explosion  disaster  in  Flixborough.  Britain  in  1974  (Lagadec. 
1981)  a  new  technician,  who  had  little  experience  dealing  with  chemicals,  was  virtually  unable  to  handle 
the  situation  and  his  lack  of  experience  accelerated  the  disaster. 

*^We  also  examined  the  case  where  organizational  members  are  trained  experientially  on  a  task 
where  most  events  are  friendly  and  then  are  faced  with  a  series  of  maydays.  The  results  demonstrated  that 
training  can  degrade  performance  below  guessing.  An  organizations  whose  members  were  trained  in  this 
way  can  perform  even  worse  thati  an  organization  of  untrained  agents. 

*^For  detailed  data  see  the  Appendix.  Figure  5  is  based  on  Table  A1 . 

*^For  detailed  data  see  Tables  A2.  A3.  A4.  and  AS  in  Appendix. 

20we  also  have  figures  showing  performance  under  murphies.  The  performance  is  flatter,  which 
indicates  that  though  murphies  generally  degrade  organizational  performance,  under  certain  conditions 
murphies  may  also  help  organizational  performance,  such  as  in  the  case  of  missing  information  when  an 
organization  is  operationally  trained. 
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APPENDIX 


Table  Al:  Organizational  Performance  by  Number  of  Murphies 


Training  Type 

External 

Condition 

Murphy 

Nunnber=0 

Murphy 

Number=l 

Murphy 

Number=2 

Murphy 

Number=3 

Experiential  ly 

Overall 

62.18(0.96) 

60.47(0.93) 

59.27(0.94) 

57.79(0.97) 

Trained 

Mavdavs 

74.91(2.18) 

71.64(2.13) 

69.53(2.12) 

67.27(2.10) 

Operationally 

Overall 

57.29(0.75) 

55.29(0.56) 

53.79(0.55) 

51.89(0.56) 

Trained 

Mavdavs 

85.67(0.67) 

83.39(0.66) 

80.83(0.70) 

77.40(0.77) 

Note:  n=320  in  each  cell.  Standard  errors  are  in  parentheses. 


Table  A2;  Performance  of  Experientially  Trained  Organizations  across  all  External  Conditions  by 


Task  Environment  and  Murphy  Type 

Task 

Environment 

Missing 

Information 

Incorrect 

Information 

Agent 

Unavailability 

Communication 

Breakdown 

Agent 

Turnover 

Unbiased 

50.79 

47.38 

52.16 

52.13 

48.93 

Decomposable 

(1.47) 

(1.36) 

(1.53) 

(1.54) 

(1.64) 

Unbiased 

45.74 

44.31 

47.97 

47.86 

41.90 

Non- 

(1.17) 

(1.04) 

(1.16) 

(1.18) 

(1.31) 

decomposable 

Biased 

61.04 

60.84 

61.81 

61.64 

55.49 

Decomposable 

(0.38) 

(0.33) 

(0.50) 

(0.50) 

(1.04) 

Biased 

85.04 

84.67 

85.39 

85.39 

78.06 

Non- 

(0.14) 

(0.15) 

(0.21) 

(0.21) 

(1.44) 

decomposable 

Note:  There  are  64  tvpes  of  organizations  in  each  cell.  Standard  errors  are  in  parentheses. 


Table  A3;  Performance  of  Operationally  Trained  Organizations  across  AU  External  Conditions  by 


Task  Environment  and  Murphy  Type 

Task 

Environment 

Missing 

Information 

Incorrect 

Information 

Agent 

Unavailability 

Communication 

Breakdown 

Agent 

Turnover 

Unbiased 

68.15 

60.49 

71.34 

71.93 

77.81 

Decomposable 

(1.05) 

(1.51) 

(0.83) 

(0.78) 

(1.14) 

Unbiased 

51.93 

47.43 

55.50 

55.75 

56.22 

Non- 

(0.57) 

(0.85) 

(0.34) 

(0.35) 

(0.31) 

decomposable 

Biased 

47.45 

45.03 

48.33 

48.52 

47.80 

Decomposable 

(0.18) 

(0.35) 

(0.15) 

(0.15) 

(0.20) 

Bia.sed 

46.84 

46.23 

48.59 

48.60 

47.33 

Non- 

(0.47) 

(0.47) 

(0.37) 

(0.37) 

(0.49) 

decomposable 

Note:  There  are  64  tvpes  of  organizations  in  each  cell.  Standard  errors  are  in  parentheses. 


Table  A4:  Performance  of  Experientially  Trained  Organizations  by  Task  Environment  and  Murphy 
_ Type  When  Faced  with  Mavdavs 


Task 

Environment 

Missing 

Information 

Incorrect 

Information 

Agent 

Unavailability 

Communication 

Breakdown 

Agent 

Turnover 

Unbiased 

85.62 

82.59 

91.83 

91.99 

78.15 

Decomposable 

(1.50) 

(1.77) 

(1.06) 

(1.07) 

(2.31) 

Unbiased 

95.19 

90.25 

94.52 

94.47 

79.58 

Non- 

(0.92) 

(1.39) 

(1.15) 

(1.16) 

(2.08) 

decomposable 

Biased 

99.44 

98.69 

99.17 

99.23 

81.54 

Decomposable 

(0.12) 

(0.26) 

(0.32) 

(0.33) 

(2.47) 

Bia-sed 

99.99 

99.48 

99.98 

99.98 

90.86 

Non- 

(0.01) 

(0.17) 

(0.01) 

(0.01) 

(1.87) 

decomposable _ 

Note:  There  are  64  tvpes  of  organizations  in  each  cell.  Standard  errors  are  in  parentheses. 


Table  A5;  Performance  of  Operationally  Trained  Organizations  by  Task  Environment  and  Murphy 
_ Type  When  Faced  with  Maydays _ _ 


Task 

Environment 

Missing 

Information 

Incorrect 

Information 

Agent 

Unavailability 

Communication 

Breakdown 

Agent 

Turnover 

Unbiased 

83.61 

75.20 

89.67 

90.25 

92.97 

Decomposable 

(1.01) 

(1.57) 

(0.64) 

(0.61) 

(0.51) 

Unbiased 

76.12 

69.91 

80.81 

81.24 

81.37 

Non- 

(0.82) 

(1.17) 

(0.56) 

(0.58) 

(0.56) 

decomposable 

Biased 

65.80 

61.17 

70.49 

70.91 

69.62 

Decomposable 

(0.85) 

(1.00) 

(0.66) 

(0.67) 

(0.83) 

Biased 

47.10 

46.57 

49.37 

49.36 

47.71 

Non- 

(0.61) 

(0.61) 

(0.48) 

(0.48) 

(0.62) 

decomposable _ 

Note:  There  are  64  tvpes  of  organizations  in  each  cell.  Standard  errors  are  in  parentheses. 


Figure  1.  Stylized  Radar  Task 


Figure  2.  Task  Environments 
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Unbiased  Decomposable 

SUM  =  Fl+F2+F3+F4+F5+F6+n+F8fF9 

If  9  <=  suni<=  16  then  aircraft  is  friendly 
If  17  <=  sum<=  19  then  aircraft  is  neutral 
If  20  <=  sum<=  27  then  aircraft  is  hostile 

Unbiased  Non-Decomposable 

SUM  =  2*Fl*F2*F3+2*F4*F5+F6+n+2»F7*F8*F9 

If  8  <=  sum  <=  33  then  aircraft  is  friendly 
If  34  <=  sum  <=  49  then  aircraft  is  neutral 
If  50  <=  sum  <=  132  then  aircraft  is  hostile 


Biased  Decomposable 

SUM  =  Fl+F2+F3+F4+F5+F6+F7-fF8+F9 

If  9  <=  sum  <=  1 3  then  aircraft  is  friendly 
If  14  <=  sum  <=  17  then  aircraft  is  neutral 
If  18  <=  sum  <=  27  then  aircraft  is  hostile 


Biased  Non-decomposable 

SUM  =  2*Fl*F2*F3+2*F4*F5+F6+n+2*F7*F8*F9 
If  8  <=  sum  <=  29  then  aircraft  is  friendly 
If  21  <=  sum  <=  23  then  aircraft  is  neutral 
If  24  <=  sum  <=  132  then  aircraft  is  hostile 
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Figure  3.  Organizational  Structures 


Figure  4.  Task  Decomposition  Schemes 
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Figure  5.  Organizational  Performance  by  Number  of  Murphies 
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Figure  6.  Organizational  Performance  by  Task  Environment  and  Murphy  Type 
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Figure  8.  Average  Performance  of  Operationally  Trained  Organizations  under  Optimal 

Operating  Conditions 
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Figure  9.  Performance  of  Experientially  Trained  Organizations  under  Optima]  Operating 

Conditions  when  Faced  with  Maydays 
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Figure  10.  Performance  of  Operationally  Trained  Organizations  under  Optimal  Operating 

Conditions  when  Faced  with  Maydays 
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Table  1:  Organizational  Performance  by  Type  of  Training 


Organizational 
Training  Type 

Internal  Operating 
Condition 

External  Condition 

Overall 

Mavdavs 

Untrained 

Overall 

33.33(0.00) 

33.33(0.00) 

Optimal 

33.33(0.00) 

33.33(0.00) 

Mumhies 

33.33(0.00) 

33.33(0.00) 

Experientially 

Overall 

59.93(0.48) 

92.63(0.35) 

Trained 

Optimal 

62.18(0.96) 

96.63(0.43) 

Murohies 

59.18(0.55) 

91.30(0.43) 

Operationally 

Overall 

54.56(0.31) 

69.96(0.45) 

Trained 

Optima] 

57.29(0.75) 

72.92(0.98) 

Murohies 

53.66(0.33) 

68.98(0.51) 

Note:  In  each  training  type  consisting  of  three  rows,  for  the  first  row  n  (types  of 
organizations)  =1280,  for  the  second  row  n=320,  and  for  the  third  row  n=%0.  Standard 
errors  are  in  parentheses. 


Table  2:  Organizational  Performance  by  Task  Environment 


Task  Environment 

External  Condition 

Organizational  Training  Type 

Experiential 

Operational 

Unbiased 

Overall 

53.48(1.85) 

77.81(1.02) 

Decomposable 

Mavdavs 

91.51(1.29) 

92.97(0.46) 

Unbiased 

Overall 

48.61(1.15) 

56.22(0.28) 

Non-Decomposable 

Mavdavs 

95.45(0.83) 

81.37(0.50) 

Biased 

Overall 

61.23(0.36) 

47.80(0.18) 

Decomposable 

Mavdavs 

99.56(0.12) 

69.62(0.74) 

Biased 

Overall 

85.39(0.19) 

47.33(0.44) 

Non-  Decomposable 

Mavdavs 

99.98(0.01) 

47.71(0.56) 

Note:  In  each  cell,  n 

=  80  types  of  organizations.  Standard  errors  are 

in  parentheses. 

Table  3:  Performance  of  Experientially-Trained  Organizations  Under  Optimal  Operating 

Conditions 


Task  External  Condition 

Environment  Overall  Mavdavs 


Top 

Bottom 

Top 

Bottom 

Unbiased 

Decomposable 

Team  with  voting 
Segregated 
(per=  100.00) 

Team  with 

manager 

Overlapped 

(per=37.38) 

Team  with  voting 
Segregated 
(per=  100.00) 

Team  with 

manager 

Overlapped 

(per=62.79) 

Unbiased 

Non- 

decomposable 

Team  with  voting 
Overlapped 
(per=62.48) 

Team  with 

manager 

Segregated 

(per=34.50) 

Hierarchy 

or 

matrix 

Blocked 

(per=  100.00) 

Team  with  voting 

Blocked 

(per=72.40) 

Bia.sed 

Decomposable 

Matrix 

Distributed 

(per=70.06) 

Team  with  voting 
Segregated 
(per=57.97) 

Any  structure 

Blocked 

(per=  100.00) 

Team  with 

manager 

Segregated 

(per=96.02) 

Biased 

Non- 

decomposable 

Hierarchy 

or 

matrix 

Team  with  voting 
Except  blocked 
(per=84.58) 

Any  Structure 
Except  blocked 
(per=  100.00) 

Any  structure 

Blocked 

(per=99.92) 

Blocked 

(per=88.83) 


Note;  Performance  is  measured  as  percentage  of  correct  decisions  over  presented  problems. 


Table  4;  Performance  of  Operationally-Trained  Organizations  Under  Optimal  Operating 

_ Conditions _ 

Task  External  Condition 

Environment  Overall  Mavdavs 


Top 

Bottom 

Top 

Bottom 

Unbiased 

Decomposable 

Team  with  voting 

or 

team  with  manager 
Segregated 
(per=  100.00) 

Matrix 

Distributed 

(per=66.04) 

Team  with  voting 

or 

team  with  manager 
Segregated 
(per=  100.00) 

Hierarchy 

Overlapped 

(per=88.62) 

Unbiased 

Non- 

decomposable 

Team  with  voting 
Segregated 
(per=59.99) 

Matrix 

Blocked 

(per=52.80) 

Matrix 

Distributed 

(per=88.13) 

Team  with 

manager 

Blocked 

(per=76.07) 

Biased 

Decomposable 

Team  with  voting 

or 

team  with  manager 
Segregated 
(per=50.58) 

Hierarchy 

Overlapped 

(per=45.20) 

Matrix 

Distributed 

(per=79.27) 

Team  with 

manager 

Segregated 
(per=59. 16) 

Biased 

Non- 

decomposable 

Matrix 

Blocked 

(per=53.62) 

Team  with  voting 

or 

team  with  manager 
Segregated 
(per=41.31) 

Matrix 

Blocked 

(per=56.13) 

Team  with  voting 

or 

team  with  manager 
Segregated 
(per=40.30) 

Note;  Performance  is  measured  as  percentage  of  correct  decisions  over  presented  problems. 


Table  5:  Organizational  Performance  by  Match  of  Organizational  Complexity  and  Task 

Complexity 


External 

Training  Type 

Internal 

Match 

Match 

Match 

Condition 

Condition 

=  1 

=2 

=3 

Expjerientially 

Overall 

54.05(0.99,160) 

59.45(0.69,640) 

62.52(0.79,480) 

- 

Trained 

Ootimal 

56.82(1.82,40) 

61.74(1.45,160) 

64.55(1.55,120) 

Murohies 

53.13(1.17,120) 

58.69(0.79.480) 

61.85(0.91,360) 

Overall 

Operationally 

Overall 

49.61(0.37,160) 

54.90(0.48,640) 

55.77(0.49,480) 

Trained 

Optimal 

51.50(0.47,40) 

57.98(1.19,160) 

58.30(1.16,120) 

Murohies 

48.98(0.46,120) 

53.87(0.49.480) 

54.92(0.52,360) 

Exp»erientially 

Overall 

88.98(1.07,160) 

92.21(0.53.640) 

94.40(0.48,480) 

Trained 

Optimal 

95.14(0.90,40) 

96.15(0.76,160) 

97.76(0.44,120) 

Murohies 

86.93(1.34,120) 

90.90(0.65,480) 

93.28(0.61,360) 

Mavdavs 

Operationally 

Overall 

73.81(0.62,160) 

70.09(0.65,640) 

68.51(0.81,480) 

Trained 

Ootimal 

77.42(0.81,40) 

73.25(1.42,160) 

70.97(1.76,120) 

Murohies 

72.61(0.76,120) 

69.04(0.72,480) 

67.69(0.90,360) 

Note;  Standard  errors  and  number  of  cases  (n)  are  in  parentheses.  Match  is  defined  as:  1  -- 
complex  organization  with  simple  task,  or  simple  organization  with  complex  task;  2  --  moderate 
organization  with  complex  task,  or  moderate  organization  with  simple  task,  or  complex 
organization  with  moderate  task,  or  simple  organization  with  moderate  task;  3  --  complex 
organization  with  complex  task,  or  simple  organization  with  simple  task,  or  moderate 
organization  with  moderate  task; 
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Dr.  Jesse  Orlansky 
Inst,  for  Def.  Analyses 
1801  N.  Beauregard  St. 
Alexandria,  VA  2231 1 

Dr.  Glenn  Osga 

NOSC,  Code  441 

San  Diego,  CA  92152-6800 

Wayne  M.  Patience 
Amer.  Council  on  Educ. 

GED  Testing  Service,  Suite  20 
One  Dupont  Circle,  NW 
Washington,  DC  20036 

Perceptual  Science 
Code  1142PS 
Office  of  Naval  Rsrch. 

Arlington,  VA  22217-5000 


C.V.  (MD)  Dr.  Antonb  Peri 
Captain  ITNMC 
Maripers  U.D.G.  3’  Sez 
MINISTERO  DIFESA  -  MARINA 
00100  ROMA  -  ITALY 

CDR  Frank  C.  Petho 
Naval  Postgraduate  School 
Code  OR/PE 
Monterey,  CA  93943 

Dept,  of  Admin.  Sciences 
Code  54 

Naval  Postgrad.  School 
Monterey,  CA  93943-5026 

Dr.  Kristina  Pollack 
Swedish  Air  Force  Staff 
Flight  Safety  &  Med.  Inspection 
S-10784  Stockholm  SWEDEN 

Psyc  Info  -  CD  and  M 
American  Psych.  Assoc. 

1200  Uhle  Street 
Arlington,  VA  22201 

Mr.  Peter  Purdue  (55Pd) 
Operations  Research 
Naval  Postgraduate  School 
Monterey,  CA  93943 

Dr.  Fred  Reif 
CDEC,  Smith  Hall 
Carnegie-Mellon  Univ. 
Pittsburgh,  PA  15213 

Dr.  Charles  M.  Reigeluth 
Chairman,  Instruct.  Sys.  Tech. 
School  of  Ed.,  Rm.  21 0 
Indiana  University 
Bloomington,  IN  47405 

Dr.  Daniel  Reisberg 
Reed  College 
Department  of  Psychology 
Portland,  OR  97202 

Dr.  Edwina  L.  Rissland 
Dept.  Comp.  &  Info.  Sci. 

Univ.  of  Massachusetts 
Amherst,  MA  01003 

Mr.  W.A.  Rizzo,  Head 
Human  Factors  Div. 

Naval  Training  Sys.  Ctr. 

Code  26 

12350  Research  Parkway 
Orlando,  FL  32826-3224 


Dr.  William  B.  Rouse 
Search  Technology,  Inc. 

4725  Peachtree  Corners  Cir. 

Suite  200 

Norcross,  GA  30092 

Kol.  Drs.  R.H.  Rozeboom 
Commandant  Luchtmacht 
Elektronische  en  Technische 
School,  Postbus  9203 
6800  HD  ARNHEM 
The  NETHERLANDS 

Dr.  Eduardo  Salas 
Human  Factors  Div. 

(Code  262) 

1 2350  Research  Parkway 
Naval  Training  Sys.  Ctr. 

Orlando,  FL  32826-3224 

Dr.  A.  SchmkJt-Neilson 
HCI  Lab.,  Code  5532 
Naval  Research  Laboratory 
Washington,  DC  20375-5000 

Dr.  Alan  H.  Schoenfeld 
University  of  California 
Department  of  Education 
Berkeley,  CA  94720 

Dr.  Mary  Schratz 
4100  Parkside 
Carlsbad,  CA  92008 

Dr.  Robert  J.  Seidel 
US  Army  Research  Inst. 

5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

Dr.  Kishore  Sengupta 
Dept,  of  Admin.  Services 
Code  54,  SE 
Naval  Post  Grad.  School 
Monterey,  CA  93943-5000 

Dr.  Daniel  Serfaty 
Manned  Systems  Group 
Alphatech  Inc. 

50  Mall  Road 
Burlington,  MA  01803 

Dr.  Michael  G.  Shafto 
NASA  Ames  Rsrch.  Ctr. 

Mail  Stop  262-1 

Moffett  Field,  CA  94035-1000 

Dr.  Valerie  L.  Shalin 
Dept,  of  Indus.  Eng. 

State  Univ.  of  New  York 
342  Lawrence  D.  Bell  Hail 
Buffalo,  NY  14260 


Mr.  Richard  J.  Shavelson 
Grad.  School  of  Education 
University  of  California 
Santa  Barbara,  CA  93106 

Or.  Kazuo  Shigemasu 
7-9-24  Kugenuma-Kaigan 
Fujisawa  251  JAPAN 

Dr.  Ben  Shneiderman 
Dept,  of  Computer  Science 
University  of  Maryland 
College  Park.  MD  20742 

Dr.  Ted  Shortliffe 
Medical  Comp.  Sci.  Group 
MSOB  X-215,  Scl.  of  Med. 
Stanford  University 
Stanford,  CA  94305-5479 

Dr.  Randall  Shumaker 
Naval  Research  Laboratory 
Code  5500 

4555  Overlook  Ave.,  SW 
Washington.  DC  20375-5000 

Dr.  John  Silva 
Scientific  Director 
Naval  Health  Rsrch.  Ctr. 

PO  Box  85122 

San  Diego.  CA  92186-5122 

Dr.  Edward  Silver 
LRDC 

University  of  Pittsburgh 
3939  O'Hara  Street 
Pittsburgh,  PA  15260 

Dr.  Jerome  E.  Singer 
Dept,  of  Medical  Psych. 
Uniformed  Services  Univ. 
of  the  Health  Sci. 

4301  Jones  Bridge  Road 
Bethesda,  MD  20814-4799 

Dr.  Juhani  Sinivuo 
Gen’l  Headqrtrs.  Training  Section 
Military  Psych.  Office,  PL  919 
SF-00101  Helsinki  10 
FINLAND 

Dr.  Jan  Sinnott 
Dept,  of  Computer  Sci. 

Towson  State  University 
Towson,  MD  21204 

Dr.  Garold  Stasser 
Department  of  Psychology 
Miami  University 
1 04  Benton  Hall 
Oxford,  OH  45056 


Dr.  Patrick  Suppes 
Stanford  Univ. 

Inst,  for  Math.  Studies 
in  the  Social  Sciences 
Stanford,  CA  94305-4115 

Dr.  Sharon  Tkacz 
CAE-Link  Corporation 
209  Madison  Street 
Alexandria,  VA  22314 

Dr.  Amos  Tversky 
Stanford  University 
Dept,  of  Psych.,  Building  420 
Stanford,  CA  94305 

Chair,  Dept,  of  Psych. 

University  of  Maryland 
Baltimore  County 
Baltimore,  MD  21228 

Dr.  Jerry  Vogt 
Department  of  Psychology 
St.  Norbert  College 
De  Pere,  Wl  54115-2099 

Dr.  Ralph  Wachter 
ONR  Code  1133SS 
800  North  Quincy  Street 
Arlington,  VA  2221 7 

Elizabeth  Wald 
Office  of  Naval  Tech. 

Code  227 

800  North  Quincy  Street 
Arlington,  VA  22217-5000 

Dr.  Thomas  S.  Wallsten 
Department  of  Psychology 
CB#  3270,  Davie  Hall 
Univ.  of  N.  Carolina 
Chapel  Hill,  NC  27599-3270 

Dr.  Eric  Wanner 
Russell  Sage  Foundation 
112  E.  64th  Street 
New  York.  NY  10021 

Dr.  David  Wiley 

School  of  Educ.  &  Social  Policy 
Northwestern  University 
Evanston,  IL  60208 

Dr.  Kentaro  Yamamoto 
03-0T,  ETS 
Rosedale  Road 
Princeton,  NJ  08541 

Dr.  Joseph  L.  Young 
NSF,  Room  320 
1800  G  Street.  NW 
Washington,  DC  20550 


Prof.  Gerard  de  Zeeuw 
Center  for  Innovation 
and  Coop.  Technology 
Grote  Bickersstraat  72 
1013  KS  Amsterdam 
The  NETHERLANDS 

Dr.  Clint  Bowers 
Dept,  of  Psych. 

Univ.  of  Central  Florida 
Orlando,  FL  32816 

Dr.  Kathleen  Carley 
Dept,  of  Social  &  Dec.  Sci. 
Carnegie-Mellon  University 
Pittsburgh,  PA  15213 

Dr.  Susan  Chipman 
Cognitive  Science  Program 
Office  of  Naval  Research 
800  N.  Quincy  Street 
Arlington,  VA  22217-5000 

Dr.  Lorraine  Duffy 
Ground  Operations  Branch 
AFHRL/LRG 
Wright  Patterson  AFB 
OH  45433-6503 

Dr.  Steve  Hinkle 
Dept,  of  Psych. 

Miami  University 
Oxford.  OH  45056 

Dr.  John  R.  Hollenbeck 
Dept,  of  Mgmt. 

Michigan  State  University 
East  Lansing,  Ml  48824-1121 

Mr.  Kent  Hull 

Decision  Sci.  Consortium,  Inc. 
1 895  Preston  White  Drive 
Suite  300 

Reston,  VA  22091-4369 

Dr.  Gary  Klein 
Klein  Associates,  Inc. 

800  Livermore  Street 

P.O.  Box  264 

Yellow  Springs,  OH  45387 

Dr.  Donald  L.  Lassiter 
Dept,  of  Psych. 

Univ.  of  Central  Florida 
Orlando.  FL  32816 

Dr.  Alan  M.  Lesgold 
Univ.  of  Pittsburgh 
LRDC,  Room  516 
3939  O’Hara  Street 
Pittsburgh,  PA  15260 


Or.  Alexander  Levis 
Lab.  for  Info.  &  Dec.  Sys. 
Massachusetts  Inst,  of  Tech. 
Room  35-410 
Cambridge,  MA  02139 

Dr.  Michael  F.  O'Connor 
Dec.  Sci.  Consortium,  Inc. 

1895  Preston  White  Drive 
Suite  3000 

Reston,  VA  22091-4369 

Dr.  Judith  Orasanu 

Mail  Stop  239-1 

NASA  Ames  Research  Ctr. 

Moffett  Field,  CA  94035 

Dr.  Willard  S.  Vaughan,  Jr. 

Cog.  &  Neural  Sci.  Div. 

Office  of  Naval  Rsrch.,  Code  1142 
800  N.  Quincy  Street 
Arlington,  VA  22217-5000 

Dr.  Ruth  Willis 
Naval  Training  Sys.  Ctr. 

Code  262 

12350  Resea  ch  Parkway 
Orlando,  FL  3<’826-3224 

Mary  Conners,  Ph.D. 

N262-1,  NAS4-Ames  Rsrch.  Ctr. 
Moffett  Field,  CA  94035 


